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The final report describes the syntactic, semantic, 
and tutorial components of the Interactive Language Instruction 
Assistance for the Deaf (ILIAD) system and the steps that have been 
taken t,o implement ILIAD on a microcomputer. It* is explained that the 
ILI&D design allows for highly itteractive tutorials in which the 
deal, learner specifies the content of 'each lesson; ILIAD in turn 
creates an individualized lesson according to the learner' s 
specifications. Following an introductory chapter, chapter 2 surveys , 
the linguistic and tutorial f eaturs %f the ILIAD system with an 
overview of the philosophy and design underlying the tutorials and 
capsule summaries of various components of the ILIAD system. Chapter 
3 describes the syntactic and semantic capabilities and the structure 
of the dictionary in the ILIAD system. A fourth chapter details - 
several types of language tutorials, including those on sentence ^ 
judgment, questions, subject-verb agreement, sentence patterns,, 
politeness, and the "please" request. Various system development 
tools, such as the constraint mechanism, are reviewed in chapter 5. 
Microcomputer implementation of ILIAD is described in chapter 6 in 

terms of two subsystems — 'the utility section (which provides 

definitions and processing procedures- for a variety of—daira — ~ 
structures used by the generation section) and the* generation section 
(which corresponds to the generation part of ILIAD). Chapter 7 
reviews dissemination* of ILIAD, while the final chapter briefly 
considers the future of ILIAD. A list of sentences generated by ILIAD 
Completes the report. (SW) 



******************************************** 

* Reproductions supplied by EDRS are the best that can be made * 

* from the original document. * 
**************************************************** 



Report No. 4771 

c. 



Final Report 
ILIAD: Interactive Language 
Instruction Assistance for the Deaf 
September 1980 - September 1981 

Madeleine Bates 

KirkWilson - 



fc CENTER |ERtC> 

reproduction quality _ 

position oi poi«cy. 



Prepared by: 

Bolt Beranek and Newman Inc, 
10Moulton Street 
Cambridge, MA 02138 



Prepared for: 

L : 

t -» * 

Office of Special Education * * 

Department of Education 
Grant and Procurement Management Division 
400 Maryland Avenue, S.W., ROB-3 r R6om 5662 
Washington, D.C. 20202 

Attention: porland Bridgland ^ 

Grantspfficer J 

[Dr, Allen Difrnnnn, Project Officer] * - 



Report No. 4771 



Bolt°Beranek and Newman Inc. 



Table of Contents 

1. Summary \ 1 

2. Overview 3 

2.1 The Problem * 3 

2.2 ILIAD'S Approach to a Solution 3 t 

2.3 ILIAD Linguistics 0 5 

2.4 ILIAD Language Tutorials 7 
2.5MicrolUAD . o 9 

3. The Linguistics of ILIAD * 13 

3.1 Syntactic Capability ^ ,15 

3.1.1 Base Component 15 

3.1.2 Transformations .17 

3.1 .3 Control Capabilities 25 
3;2Semantic Capability and the Dictionary 29 

3.2.1 Semantics - 29 

3.2.2 Dictionary 31 

3.2.3 More Powerful Semantics ' 33 

4. The Language Teaching of ILIAD 37 

4.1 General Tutorial Features / 37 

4.1.1 Levels -37 

4.1.2 Messages to the Student* 39 

4.1.3 Uniform Commands 39 

4. 1.4 Syntactic Choices 40 

4.2 Ser£tent^WdgerhenT Tuiorfar / 41 
4.30uestiQn Tutprial ' -42 

4.4 Subject- Vejb Agreement Tutorial / * * 45 

4.5 Pattern-Tutorial — ■ J "^47 

4.6 Politeness Tutorial 49 

4.7 Please Tutorial £2 

-5rSystenrrD0velopment Tools v v 55 

5.1 Constraint Mechanism 55 

5. 1 .1 Relationships between Synspecs * 55 

5. 1 .2 Action of the Constraint Mechanism v 56 

5.1.3 Efficiency Considerations 57 

5.2 The Syntactic Playgrbund * 57 

6. Microcomputer Implementation 59 

6.1 Utility Section t 59 

6.2 Generation Section 60 

6.2.1 Base Component .60 

6.2.2 FeaUire-Bjised Semantics. 61 

6.2.3 KLONE- Based Generation 62 



Bolt Beranek and Newman Inc. 



• 6.2.4 Transformational Component 

7. Dissemination 

7.1 Reports and Presentations 
• 7.2 ILIAD/Deafnet Project 

8. FutureofUIAD 
A. Sentences Generated by ILIAD 




0 



0 

tist of Figures 

Figure 2*1: ILIAD Tutorials in Relation to the Generator r ; 8 

Figure 3* 1 : The Sentence Generator 13 

Figure 3*2: Base Constraints and Their Values 16 

Figure 3*3: Features in the X-Bar System * 17 
Figure 3*4: Sample Base Structure -18 

Figure 3*5: Sample Transformation 19 

Figure 3:6: Unmorphed Tree Structure 25 

Figure 3*7: Morphed Tree Structure 26 

Figure 3-8: Sample SynSpec 28 

Figure 3-9: Sample Meta SynSpec 29 

Figure 3-10: Portion of ILIAD Semantic Network ~" 32 



Report No. 4771 . Bolt Beranek and Newman Inc. 



i.Summary 

This report describes the syntactic, semantic arid tutorial components of the ILIAD language 
instruction system and the steps that have been takerrtb implement ILIAD on a microcomputer. The 
-goal of thik work has been Jo design and implement an English language instruction system capable 
of generating a broad range of rr?eaningfu! sentences as examples or exercises in tutorial lessons. 
This goal has been reached. 

The IlFad design allows for highly interactive tutorials in whictithe learner specifies the content 
of each lesson; ILIAD in turn creates an individualized lesson according* to the learner's 
specifications. Because of the generative capability of ILIAD, the system continues to present 
examples or exercises for as long as the learner desires to study a particular grammatical or 
functional aspect of language use.-, 

The .prototype computer implementation of ILIAD has been written in InterlISP on a DEC 
Systemic computer at Bolt Beranek and Newman. Over the past two years a prototype 
microcomputer version of* ILIAD has been designed' and implemented. The microcomputer design 
has involved evaluation and modification of InterLISP ILIAD components for use in a UCSD-Pascal 
program. The microcomputer implementation, MicrolLIAD, is now a functional language generation 
system with a subset of ILIAD syntactic capabilities and a flexible system of semantic representation. 
The MicrolLIAD semantic system f\as allowed for a variety of tests and subsequent improvements of 
the original ILIAD semantics. 

Foi two years ILIAD has been used by deaf children at the Boston School for the Deaf, by-deaf— 
children using a terminal in their homes, and by adults with access to the Deafnet computer 
communication system in the Boston area. Having deaf children and adults use and comment on 
prototype versions of ILIAD has been an important component in the design process of the ILIAD 

0 

system. , 



U 
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2. Overview " ** 

This .chapter surveys the linguistic ar\d tutorial features" of the ILIAD jsys'tem. It provides a 
concise overview of the philosophy and design underlying the tutorials and Capsule si^mmaries of the , 
various subcomponents of the ILIAD system. 

2.1 the Problem 

Recent technological developments have opened doors of opportunity for millions of 
handicapped people, yet many problems are exceedingly complex and require considerable 
innovation to reach even a partial solution. Foremost among these is the dilemma of language 
development in deaf children. Profound congenital deafness results in extreme delay in all aspects of 
language acquisition as well the formation of certain persistent^deviant strategies for language 
tximprehension and production. 

Studies of deaf children indicate that English grammatical processes such as passivization, 
negation, question formation, relativization, complementation, and the formation of complex verb 
phrases pose particular problems for deaf students. Even students who appear to have mastered 

these constructions in isolation may be unable to combine them in a* single utterance or to 

* • **** 

comp/ehend them when combined in complex sentences. 

^ 9 

* 

Hearing childrenleamJtieiLJanguage while constantly immersed in it; they are surrouhded by 
people and things (TV and radio) that use language almost incessantly. Dea? children, in contrast, are 
cut off from most sources of language and thus do not have the data from which to form hyfrotheses__ 
about how their language works. ILIAD is an attempt to increase the language data available to deaf 

children, It is an environment allowing a child (perhaps under parent or teacher supervision) to 

/ 

expe/ience language in a manner that is carefully controlled though not limited. Qpce a tutorial has 
been started and tailored to the student's specific needs, ILIAD can generate an unlimited number of 
sentences for illustration and practice, ** 

2.2 ILIAD's Approach to a Solution 

The ILIAD Project has had as its goal the development of a generative computer system to aid 
deaf students in both tho production and comprehension of written English sentences. The focus of 
the system is not on what to teach but rather on how to learn. For this reason, it is designed to be a 
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tutorial resource which is in large part under student control. Within certain limitations, the learner 

decides the content and basic features of each interactive tutorial session. 



The basic characteristics of the ILIAD language tutorials are as follows: (1) the student has 
immediate control oyer the tutorial dialogue (ie., the student can simplify a. lessen or make it more 
complex according to his/her current level of language understanding); (2) examples of correct 
usage are provided using vocabulary within appropriate contexts and at the student's level of 
comprehension; and (3) the system is sufficiently motivating to encourage exploration of new areas of 
English with unlimited opportunity for continued practice on aspects of English not yet completely 
learned. p % ~* 

To provide sophisticated language tutorials meeting individual needs, ILIAD has been 
implemented using techniques of artificial intelligence. Its intelligence is in the form of u knowledge" % 
about the structure of English along with "skills" to provide highly individualized tutorials focusing on 
different aspects of language use. The linguistic knowledge provides its capability to generate a 
broad range of simple to extremely complex English structures. The generative capacity is primarily 
syntactic, but ILIAD also knows a small amount about English semantics and the pragrifatics 
(functions) of certain English sentence forms. With its knowledge of the English language, ILIAD has 
very powerful resources to individualize instruction in both grammatical and functional aspects of 
language use. 



ERIC 



The ILIAD design has two flexible sub-systems, one specializing in linguistic capabilities and 
the other in tutorial interaction with the student.. Given a set of sentence constraints (such as: past 
tense, negative, no relative clauses, and pronominalized subject), ILIAD will create an unlimited 
number of sentences meeting these exact specifications (such as: l4 lt wasn't green", "She might not 
cry"). Such sentence*, are used to demonstrate grammatical or functional aspects of language use or 
as part of tutorial sessions to exercise the student's languaje skills. It is important to aote that the 
goal of ILIAD is to help students learn language, not grammar. 

ILIAD is also a linguistics research project, beyond its applications as a sophisticated computer 
m program to meet a specific need. As in other artificial intelligence and computational linguistics 
projects around thp country (principally in the Boston and Palo Alto areas). ILIAD has been developed 
iising the IntorLISP proyiamming system which provides a very resourceful development environment 
for huiklinu and Idling intellicjont systems. ILIAD* reprosu its-one of II .u first dloi ts to pul intelligence 
into ( omputer*btis<KJ lanquayo instruction. 

o 1 - 8 ' 
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Once the prototype design was implemented :n interLISP and briefly tested, a conversion 

process was started to implement ILIAD on a microcomputer. The UCSD-Pasc^l implementation, 

MicrolLIAD, has been started and a very preliminary version can now generate simple sentences. 

• MicrolLIAD.takes advantage of some portions of the InterLISP system and in other cases, particularly 

where microprocessor capabilities are relatively limited, new designsJVave been developed. 

• ' * 

The long range goal of ILIAD has been to become an "expert 11 lapguage tutor. By expert we 

mean a system that has some knowledge of its domain, the English language, at least in a syntactic 

& sense, and to some degree in terms of the functions and semahticc of language. 4 The system has 

been designed as a "linguistic playground 11 wherein ILIAD is not so muclrfe'teacher/diirector as a 

playmate/advisor. A successful student leafnVhow to exercise the generative resources of ILIAD to 

explore 4 wide range of simple tojcomplex language forms. • / * . % 



Throughout the design phase of ILIAQ, constant effort was made to elicit and incorporate 
suggestions from deaf children and adults, teachers, parents and school administrators. While ILIAD 
does represent a sophisticated, intelligent system relative to existing CAI (Computer Arded 
Instruction) programs, prototype implementations have Incorporated a wide range of comments from' 
deaf children aryd adults who have used ILIAD and for whom the system is intended. Thqugh ILIAD 
has some way to go before it is a field-1ested language instructioo system, it has demonstrated that a 
knowledge-based tutorial system can be successful and useful in the complex domain of language 
structure and function. ' 



2*3 ILIAD Linguistics • ' 



The heart of ILIAD is a sentence generation component based on the linguistic paradigm of 
transformational grammar. This system is quite powerful and is capable of producing sentences 
ranging from simple, single clause sentences \o complex structures which contain clausal 
complements of all types, such as, relative clauses ("The man who was angry chased Nan"), finite 
complements ("Dan said that Bette is intelligent") and infinitival compfements ("Bill persuaded the 
girls to be nice"). 

More important, than the range of sentences covered by this component is the way in which the 
Sentences are represented The sentence generator possesses dutailoJ knowledge of the syntactic 
structure of each sentence it produces'. For example, it maintains a record of the pait of speech of 
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each word in a sentence (noun, verb, deterrpiner, etc.), it notes the tense of each clause, and it is. 
' capable of cjetermining the grammatical relations borne by different constituents; for example, which 

noun in a sentence is its subject, direct object or indirect object. - In transformational terms, ILIAD 

* ° V 

produces phrase structure trees for both the deep and surface structures of each sentence.* 

Sirtce ILIAD creates a detailed syntactic representation for each senteffce that it generates, it is 
capable of-generating not only a sirgie sentence, but related sentences, as well. For example, if 
ILIAD generated the following sentence: * — 

• • * 

John ate thfe apple. , **> 

it could also generate related interrogative and pronominal forms, such as: 

Did John eat the apple? > . * N * / 

What did John eat? • * ' * 

Who ate the apple? ^ • - , 

What did John.do to the apple? * > 1 

He ate it. . ° • 



as well as other related forms not listed here. 



/ 



J r 



The ability of ILIAD to generate related sentences allows it to help students realize which 
syntactic constructions are related Foe example, the question "What did John eat?" may be 
generated by TLIAD alongside the declarative "John ate the apple", showing the student that both 
sentences are transitive (though this "meta linguistic" terminology "is avoided) and, that they are 

i , 

related by a number of simple procedures which may interact to produce more complicated 
structures. * 



\ 



In addition to its ability to produce a wide range- of sentences either singly or in groups of 
•related forms, ILIAD is also capable of producing ungiammfcrtical forms. Though this may not seem 
like an advantage, this feature of ILIAD is used in a diagnostic tutorial which tests the student's ability 
to distinguish grammatical utterances from ungrammatical ones (see Section 4.2). Moreover, the 
ungrammatical forms produced by iLIAD are not simply an ad'hoc collection of random errors. 

o * 

Rather, these forms replicat'e the ungrammatical utterances observed in the actual writings or deaf 
children. Thus, this tutorial may be used to help students to realize that these forms are not 
acceptable as standard English. At thd same time the teacher may be piovided with diagnostic' 3 
information about which unyramrnatical fomis students currently accept as correct. 



9 
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Finally, ILIAD uses its representation of the syntactic structures^* the sentences it generates to" 
produce helpful tutorial information. For example, in a tutorial which requires the student to change 
the number of the subject (e.g. to make it singular if it was plural, or vice versa), ILIAD-c^n inform the 
sjudent what the subjectpf the sentence is and whether it is inflected regularly or irregularly. 

* 

2.4 IU AT) Language Tutorials. , * m 

ILIAd tutprials focus on a a wide variety of language skills. The tutorial generates sentences 
relating to the skill it is designed to exercise and interacts with the student in a'ffiendly way, eliciting 
responses from the student and gauging and monitoring those responses. The language tutorials 
allow the student to^ specify the difficulty level that'the student, wishes to work with and also allow the < 
student to specify what type of sentences, within the framework of that tutorial's particular skiJLthe 
student would like tq see. Figure 2-1 shows schematically the relationship between the tutorials and 
the language generator- x 

ILIAD currently has six tutorials, each of which addresses a different grammatical topic and a 
different area of capability in the ILIAD system. 'The tutorials, which are discussed*!.* more depth in 
Chapter 4 below, are as follows: 

VI • 

v 

• Sentence Judgement: In this tutorial the system presents sentences tolhe students and 
asks whether they are good or bad. This tutpriaXdemonstrates that ILIAD can generate 
"both standard and nonstandard structures. 



• Subject-Vbrb Agre&ment: This tutorial exercises the student's ability to change singular 
subjects-to plurai or vice*versa and to change the verb phrase to agree with the subject. 
This tutorial demonstrates that ILIAD can provide hints to the^st udent based upon 
structural elements in the target sentence. 

• Question Formation: This tutorial deals with yes-no questions, wh-subject question 
formation, and wh-object question formation. This tutorial'demonstrates that multiple 
transformations may be specified for the exercise sentences generated by ILIAD. 

• Sentence Patterns: This tutorial was requested by a teacher at the Boston School for the 
Deaf- who uses basic sentence patterns in early language instrucjion. Students must be 
able to recognize up to five common sentence types. This tutorial demonstrated that a 
tutorial could be developed to meet a ^pebif ic need, at the requestor a.teacher, in a short 
period of time (one week). 



• Politcnoi.s ol Requeue This tutorial fofcufios not on English grammar but lathet on one of 
the linguistic skills nt.vtlnd to ptoduce requests. It Introduces the student to n wide 

t 
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• .STUDENT'S , , fclr - 1IPff 
^CONSTRAINTS'! answer 



U WANT : ' 
hard problems 
high vocabulary 
prcd-nom or 
pred-adj 



4: i 6\ 

EXERCISE / RESPONSE. 



1 ' 



I 

I ANY 
» TUTORIAL 

! * 
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AND 
STRUCTURES 
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what ty;>e o IS? 
The obese 
policeman 
wi 11- not be 
fascinatinq. 



I I.'AHT: 
easy problems 
low vocabulary 
wh- questions 
neqative 




RESPONSE: 
Correct! 



COMPLETE 
CONSTRAINTS 



CONSTRAINTS: 
^hj^JbuxojiaJ^ 
pred-adj. 
negative 
future tonse 



59. subj 
-dec 



teclaxative. 



no contraction 
adj. on subj. 




MAKE A Kit 
QUESTION: 

The boys 

didn't 

cry. 



RESPONSE: 
Right!' 



QUESTION 
TUTORIAL 



J_he j>bose__ _ 
policeman/ 
will *not be/- 
fasc'inating. 



CONSTRAINTS: 
_ low vocab. 
"wh- question 
negative . 
past tense 
Pj. subj. 
— contraction — 



no adj. 



SENTENCE JSENERfTOR 



more tutorials 



i 

DCL: * 
The boys 
didn'$ 
cry. 



4ttKMttdf^t- 




Figure 2*1: ILIAD Tutorials in Relation to the Generator 
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variety of request forms from those which are .strongly impe/ative to those which are very 
polite. ILIAD can generate over one^hundred different sentence forms for a single 
request. * 

• Use of Please in Requests: This tutorial exercises the. student's knowledge of the proper 
places to use PLEASE in a/reguest. This tutorial utilizes a form of input which is 
convenient fpr students and produces a broad range of sentence forms that test their 
understanding of the use of PLEASE. » 



2.5 MicroILIAD 



MicrolLIAD is now a prototype language generation system running on a njicrocomputer. Its 

overall structure is similar to the ILIAD system implementsd in InterLISP, but much of the design is 

different, due to the more limited computing power of the microprocessor and its memory constraints, 

* 

and because the microcomputer implementation has been used to explore different types of semantic 

components. t f 

* ~" . 

The design of MicrolLIAD has focused on achieving cseveral goals of -importance for a 
microcomputer-based ^t|m. These are: 

^Portability — The system is written in UCSD-Pascal, a widely used microcomputer 

implementation of Pascal designed to reduce • 'hardware and implementation v 

* dependencies. One version of MicrolLiAD has been run without modification on an Apple r 
Ij computer after development and compilatipn on a Z*80*t5ased computer. Development 
work has been dBne;on both the Z-80 and the Apple^with relatively minor problems in 
compatibility of programs between the two. 

• Efficiency — The internal structure of McrolLIAD relies extensively on the\jse of 

* infgrmation coded in very compact ways (typically single bytes ofstorage) which can also 
be manipulated quickly. This has^allowed the system to include all {*ograms#nd data 
structures in memory without overlays and with room for expansion for additional 
grammatical capabilities, while achieving -a sentence generation time for single clause ^ «? 
sentences of 3-6 real time seconds (Z8(J processor);* ' 

• Mbdularity — The b^sic processing in the sentence generation system is divided into 
* separate modules for generation of the base tree, semantic' analysis, and 

transformational processing (including morphology), so any basic element can be , 

* modified without altering the remainder of th9 system. There are akJigja number of utility 
modules for performing commonly needed processing and for maintaining various files of 
data structures. . o 

. ♦ Compatibility with Intut LISP ILIAD — Total compatibility with InterLISP ILIAD is not 

♦ 

• » * 

\ 0 

I 
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consistent with the -othe/ design goals of MicrolLIAD, but a substantial measures? 
compatibility has been achieved by the use of alternative data structures for system 
information. One data structure for a given type of information will be in InterLISP format, * 
while another' will be in a more compact internal representation, and programs are 
provided to convert automatically between the two data structures. This has allowed the , 
InterLISP ILIAD transformations to be used in MicrolLIAD in a form which is- suitable for 
efficient processing. * - . 

- . ■ \ 

The MicrolLIAD system has been used to explore alternative semantic representations in order 
to determine strengths and weaknesses of these representations for sentence generation. The 
syntactiC'portibjj of MicrolLIAD has been kept relatively simple compared to InterLISP ILIAD (with only 
single clause sentences and a sma!l number of transformations) in order to allow more time^to be 
& devoted to this semantic exploration. 

Three major semantic systems were investigated, and two were implemented. The first system 
explored was a semantic network representation like that of InterLISP ILIAD (see Section 3.2.1). 
While this representation is feasible for use on a microcomputer, the time and space required are 
quite large for the level of semantic analysis done and are not likely to be compatible with our 
. - efficiency goals, so this semantic network representation was not implemented. 

In an effort to gain the effect of a network semantics with more efficiency, a feature-based 
semantic representation was implemented. In this system, each word had one or more fields of 
features (either features of \he word itself or Katz & Fodor style selectional restrictions) represented 
as sets. Simple and fast set operations (union, intersection, and membership tests) could carr^ut 
the repuired semantic tests. This allowed an efficient implementation of a rough but serJMbble 
semantics, but would have required a more elaborate language for representing semantic constraints 
not expressible as feature^ (such as the complex requirements on gender and relationships between 
the subject and object of "kiss"). 

► The feature semantics was implemented with vocabularies in two domains. In a limited 
playground vocabulary, a small set of features sufficed Jo rule out most anomalous sentences, 
producing sentences such as "The sports instructors catch an ol(f soccer ball" and "The cheerful 
boy gives the bully a new football". A slightly expanded set of features was applied to a vocabulary 
chosen from newspaper stories, to*gl\e sentences with varying, degrees of coherence, from "The 
bounding president escapes the assassination attempt 0 and "The anyry Secret Sorvice agent 
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shows the cameraman thet>rave movie star 11 , to a not-so-successful 'The uncomfortable psychiatric 
examination departs 11 . Clearly, a more sophisticated semantics is necessary to cover this vocabulary 
range. y * 

A more fundamental difficulty is present for both the network-based and feature-based 
semantics. Both are set up to rule out anomalous sentences (things we "can't say") but are not 

designed to create sentences based on things we have some reason to say. So we may get 

<■ 

sentences such as,"The cat is on the mat" and ''Alicia saw the pen", both of which are grammatically 

*> 

and^semanticallft correct but which, given no prior context, have no discernible relationship to each 
other or to a hypothetical situation where both might be true, in order to deal with this problem, a new 
semantic component was designed which is based on a "representation of possible real-world 
situations in* addition to general information, with sentences being generated which express some 
aspect of the situation. In this way, sentences can be generated which are related to each other, 
because they each express aspects of the same situation. " * 

This semantic 'system is based on the ide&s of KLONE, a knowledge representation language 
developed over the past five years at Bolt Beranek and Newman. Use of the KLONE approach has 
allowed the semantics to represent not just hierarchical information as in a semantic network, but also 
relational information (e.g. properties of objects, participants in actions). This formalism 
distinguishes betwoeri general information (e.g a ball is a toy) and specific information (e,g Mary is 
sad). Generation proceeds from nodes representing specific information, so consistency is 
maintained, while the general information is used to give alternative expressions for the* same* 
situation. For example, we might generate "Mary thrfew the baseball", or from the same information 
produce the paraphrase "The sad girl threw the ball". (For a 'tirther discussion of the KLONE system, 
see Section 3.2.S.) ^ 
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3. The Linguistics of ILIAD 

The njechanism of transformational grammar was chosen for ILIAD because it offered both 
tight control over the surface syntactic form of a sentence and a good model for the production of 
groups of sentences that are syntactically related. Figure 3-1 shows the organization of the sentence 
generator. 





TftOS 


* 




Taws 
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< Figu re 3* 1 : The Sentence Generator 

* * 

Owing to its linguistic sophistication, ILIAD is able to produce a wide variety of English 
sentences. They range from commonly used constructions (transitive sentences, questions, 
passives, etc.) to expressions of great complexity, such as sentences with multiple question words 
("Who gave what to whom?"), elaborate request forms ("Would it be possible for you to open the 
door, please?"), relative clauses ("The boy who baked some cookies was kissed by the girl who ate 
them."), etc. The following list presents just a few examples of sentences illustrating the many 
sentence types that can be generated (more examples are given in Appendix A). ^ 

Intransitive sentences: 
The dogs are barking. 
Bette giggled. 
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Transitive sentences: 
The nice girl forgave the bullies. 
The policeman closed the doors. 



Transitive sentences with indirect object; 
The teacher wrote the woman a letter. 
The man gave a doll to Alicia. 



Predicate 'adjective sentences; 




Predicate nominal sentences: 
Jake is a boy. 

The doctor is a teacher. „. 

Predicate adverb sentences: 
The baseball is in the dirt, 
The kids areon the slide. - 

Request sentences: 
Tell the girls the story. 
Let dob tell the girls the story. 

Tough-Movement sentences: < ' ^> 

The girls were hard for Varda to ridicule. 

The girls were hard to ridicule. * 

Comparative sentences: f " 

The gifl is hungrier than Bob. 



Want-Complement sentences: 
Lyn wants the girls to hide. 

* * * « 

Control-Complement sentences: 
The teacher asked the boys to hurry. (Object Control) 
Dianne promised to remain happy. (Subject Control) 



The ability to (jjnnrate ILiAlVs total rango of sentences requires 200 trnnsfor nations. In 



Relative clause sentences: 
the boy who was on the bike fell. 
She saw the woman who baked that cake. 
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addition, 60 transformations were developed to generate sentences typically produced by deaf 
studentsrthese transformations are currently usedlhtRe^udgement Tutorial (SeeSectTon 4.2). 

Presently, the only major sentence types which are not generated are sentence conjunction, 
gerunds, and indirect questions. In the case of conjunction, we have deliberately refrained from, 
adding the necessary base structures because of the semantic problems presented by conjoined 
sentences; for instance, the necessity of maintaining semantic relatedness between conjuncts (to 
prevent, for example, "Candy is sweet and John likes Mary"), the requirement that conjuncts appear 
in the correct temporal order ("John died and was buried. " rather than "John was buried and died"), 
and so on, but projected changes to the semantic component will handle these correctly (see section 
3.2.3). 

3.1 Syntactic Capability , 

o 

The sentence generator is composed of three major parts: a base component that produces 
base phrase structure trees, a transformer that applies the transformational rules to derive a surface 
structure tree, and a set of mechanisms to control the operation of the first two components. We will 
discuss each of these components separately. 

3.1.1 Base Component 

The base component .produces the base tree which is associated* with the sentence to be 
generated. The input to this component is,a list of constraints which contain syntactic information 
about the type of sentence to generate (e.g. whether it is to be passive, have a relative clause on the 

0 

subject, etc.) Th^ output is a tree stiucture to which the transformations apply, to produce the 
desired Sentence as well as related sentences (in the appropriate tutorials). 

The base constraints which are the input to the base component determine the form of the base 
tree that is constructed. Most constraints take the value + or - ; others allow, in addition, a list of 
constraints, each of whose values is specified. A complete list of base constraints appears in F'gure 
3-2. 

The output of the base component is a tree structure which lepresents syntactic categories as 
in the X bar system of phrase structure. In this system, the major syntactic categories (N(oun), V(erb), 
A(djedive) and P(rj|>o:.ition)) are treated as complex symbols which are decomposable into the 
Ic.iturcu [IM|uml |: L V|. Ihc, yii.-klathocro?,:, clav ilicntion of then? calogorusiJuAMiin Figure 3 ( 3. 
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Name: 



Value: 



TNS 

SUBJECT 

DIROBJ 

INOOBJ 

VERB 

PASSIVE 

PROGRESSIVE 

FOR-COMPL 

THAT-COMPL 

WANT-COMPL 

CONTROL-COMPL 

SUBJ-TOllGH 

IMPERATIVE 

COMPARATIVE 

TRANS 

PRED-ADJ 

PRED-AOV 

PRED-NOM 



PRESENT, PAST, FUTURE-, ANY, NOT-HABITUAL 
<a list of constraints indented below> 

- or <a list of the indented constraints> 

- or <a list of the indented constraints> 

<a verb to be used as the head of the S>, NIL 
+ ,- 

+ .-.ANY 

<a list of sentence- level constraints> 



2, 3, NIL 

- or <a list of constraints indented below> 

<a number or pointer to transf constraint list> 
+ , -,<a word to be used as the adjective) 
+ .- 

- or <list of constraints indented below> 



{The following constraints apply within the context of a noun phrase.} 



EMPTY 

WH 

NU 

PER 

DEF 

ADJ 

NOUN 

PROPER 

REI.-SUBJ 

REUOBJ 

REL-INDOBJ 

MASS 

APPEAR 



+ , - (may be absent) 
+ , - (may be absent) 
SG, PL, ANY 
1,2,3 . 
+ .- 

+ ,-,?, <a word to be used as the adj> 
<a word which is to be the head noun>, NIL 
+ if NP musi be a proper noun, - if can't be, 
NIL if it does not Matter 1 
- or <a list of sentence-level constraints) 



+ ,-, NIL 



+ . 



_ o 



'Figure 3-2: Base Constraints and Their Values 
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V 

+ i," 

+ | A | N j ^ 
N | — | — | 

~ I V |P | \ . 

I — I - " I 

< 

Figure 3-3: Features in the X-Bar System 

The feature M N M marks a given category as "nounlike" (and thus corresponds to the traditional 

grammatical notion of "substantive") while "V" marks a category as "verblike". Nouns and 

adjectives .are [+N] because they share certain properties (e.g. adjectives can be used in -nominal 

contexts; in highly inflected languages, adjectives and nduns typically share the same inflectional 

paradigms, etc.) Adjectives and verbs are [+V] because they share (among other things) various 

morphological traits (e.g. certain verbal forms, such as participles, have adjectival properties). Vertys 

-and prepositions are [ - N] because they display common complement selection attributes (e.g. they 

both regularly take Nominal complements that bear Accusative Case). 

t 

In addition, each syntactic category contains a specification of its rank (given in terms of 
number of bars, hence the term "X-bar" system). For instance, a noun (N) is of rank 0 and is m 'ked 
with no bars whereas the noun phrase which it heads is of the same category but different (higner) 
rank. Intermediate structures are also permitted; for instance, V (read "V bar") is that portion of the 
verb phrase which consists of a verb and its complements (e.g. direct and indirect objects, clausal 
complements, prepositional phrases, etc.) while V" (read "V double bar") includes V as well as 
Auxiliary elements. For our purposes, we have adopted a uniform two'level structure across 
categories; that is, each category X is taken to have X" as its highest rank, so that nouaphrase (NP) in 
our system is N", verb phrase is V ', etc. Minor categories (such as DET(erminer). A.UX(iliary), 
NEG(ative), etc.) stand outside this system, as do S(entence) and S' (a sort of super sentence, which 
contains S and clause introducing elements (or "subordinating conjunctions") such as that). These 
categories are not decomposable into the features [±N] and [±V], and, except for S and S', they do 
not have different ranks. Figures 3-4 shows £ representative tree structure. 

3.1.2 Transformations ^ 

Tha transformational component modifies the base tree through the operation of certain rules 



Bolt Beranek and Newman Inc. 



Report No. 4771 



S' [ TRANS. 1 ] 
COMP [ -WH ] 
S 

N' * [ +N -V PER. 3 +DEF NU.SG GENDER . FEMALE +HUMAN +PR0PER SOCSTAT . 2 ] 
N'-_ [ h(N -V PER. 3 +DEF NU.SG GENDER. FEMALE +HUMAN +PR0PER SOCSTAT. 2 ] 
N [ l+N tV PER. 3 +DEF NU.SG GENDER. FEMALE +HUMAN +PR0PER SOCSTAT. 2 ] 
Chris 

V" [ -N +V -INDOBJ +TRANS 7PASSIVE ] 
AUX [ -NEG ] ' 

TNS [ +M +A -H ] . " - " ■ 

past 

V [ -N +V -INDOBJ +TRANS 7PASSIVE ] 
V [ -N +V -INDOBJ +TRANS ? PASSIVE ] 
steal 

N' ' [ +N -V PER. 3 +DEF NU.SG ] 
DET [ +DEF NU.SG ] 

the * 
N' ' [ +N -V PER . 3 +DEF NU.SG ] - 
N [ +N -V PER. 3 +DEF NU.SG ] 

book - - 

"Ch ris stole the booK." 

\ 

Figure 3-4: Sample Base Structure 

(transformations) to create a representation of the surface syntactic form of the sentence (the final 
* tree). Transformations are composed of three parts: a Structural Description, which is a pattern the 
tree, must match If the transformation is to be applied, a Condition (optional) which must be fulfilled in 
addition to the Structural Description if the transformation is to be applied, and a Structural Change 
which describes the modification(s) to be made to the tree. 

The Structural Change of each transformation consists of one or more functions, analogous to 
the transformational elementaries of traditional transformational theory. The operations thai are 
performed by^th^ rules are a combination of classic transformational operations (substitution,, 
adjunction, deletion, insertion of non-lexical elements such as "there' 1 and "do";, and operations that 

linguists sometimes relegate to the base or post-transformational processes (insertion, of pronouns, 

X 

morphing of inflected forms). By^making these operations rule-specific, many related forms- can be 
produced from the same base tree c,qd^ the control mechanisms outside the generator itself can 
specifywhich forms are to be produced/ The Condition of a transformation may be an arbitrarily 
complex Boolean expression or general LISP forni^vhicli either describes relations among parts of 
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4 v 

thrtr^elffarcReTBy tfie structufallJescnptibn or Specifies that some other transformation must have 
applied (or must not have applied). Asample transformation is sh&n in Figure 3-5. 

SUBJECT-AUX-INVERSION 



SD • (S' (FEATS (TRANS. 1) ) COMP (FEATS (WH.+)) * 
1 2< 

(S N' TNS- (OPT NODE (FEATS (M. +))})) 
3 4 5 '6 

SC: (DeleteNode 6) ' 
. (DeleteNode 5) 
(LChomsky 2 6) 
(LChomsky 2 5) • 4 

Condition: [NOT (EQ (QUOTE +) 

(FeatureValue (QUOTE WH) 

. (RootFeats 4] 



Figure 3-5: Sample Transformation 



The ILIAD system possesses a , transformational component whichcan produce a wide variety 

,,«'>.' v - 

of syntactic constructions. These include all of the most commonly used, simple sentence forms 

which the beginning s!udent will need to learn, as well as some of the more complex forms which the 
advanced student mighfwish to become familiar with. Further, for the convenience of those working 
on the ILIAD project, all the transformations -which are associated with a particular syntactic 
construction or with a range of related constructions areJIagged'with the same mnemonic prefix. 
(For example, those transformations responsible for the generation of .questions all begin with the 
prefix WH-; "those associated with celative clauses begin with RELATIVE-, and so on.) Thus, the v 
transformations of the present ILIAD tiansformational component are broken up into several 
"families" of related transformations as^well as several general "utility" transformations which are not 
associated with any particular syntactic construction but which enter into the derivations of various 
types of sentences. (Such "utility" transformations include NUMBER-AGREEMENT, AFFIX- 
HOPPING, various DO- insertion transformations, etc.) A complete listing of the transformations can 
be found in the report "ILIAD Data Base.Reference" cited in Section 7.1. * . 

Transformations are not only divided into families, the transformations, a&a whola, are divided 
into two tyfroo of tiansfornutiym.. cyclic tran:.forinationi and po:J cyclic transformations. The cyclic 
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transformations are further subdivided into those transformations which are used in the generation of 
grammatical sentences and "mangier" transformations which are used to generate ungramrfiatical 
utterances which are used in the Judgement Tutorial. Of the 346 transformations which'exist now, 
320 are cyclic transformations and 26 are post-cyclic, 260 of the cyclic transformations are used in 
the generation pf grammatical' sentences, and 60 are '•mangier" transformations. We will detail the 

, syntactic capabilities of each of these types of transformations separately. 

. i 

The transformations which generate grammatical sentences are divided into the following 
families (in this and the following lists of families of transformations*, each entry begins with the 
mnemonic flag associated with that family; „ the number in parentheses which follows this flag 
represents the number of transformations currently in that family): 

• ADJECTIVE- transformations (4), which are used* to form the comparative ("smarter", 
"more beautiful 1 ') and superlative ("sweetest"., "most upset") degrees of adjectives. 

• DATIVE- transformations (3), which allow for the alternation o f indirect object phrases 
with and without "to" and "for" ("John gave Mary the book" ~ "John gave the book to 
Mary"). * v 

• GR- ( = Grammatical Relations) transformations (11), which are used to find the subject, 
direct and indirect objects, main verb, and other relational^ defined portions of a 
sentence, for use in the Help system. 

• INF- (8) and INFERENCE- (3) traniiformations, which were designed for use in a projected 
, inference tutorial. 

• MODAL- transformations (14), which 'nsert the various modal verbs: "can", "m 
"must", "shall", "will? "is able to", "needsto", and "ought\o". 

• NEGATIVE- transformations (9), which include noun phrase negation ("no boys") as well^ 
as verb phrase negation ("The boy does not like candy"). 

- • ONE- (2) transformations, which insert the pronominal element "one", as in "I like the 
green one".- 

• PASSIVE- transformations (5), which produce passive sentences, including "agentless" 
passives, such as VThe girl was humiliated' 1 . 

• PERFECTIVE (2) and PROGRESSIVE- (1) transformations, which produce sentences 
with perfective ("The door has closed") and prcifiretwive {"The boy \u running") aspect. 
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• PHRASE-BDRY. transformations (3), which are "used to insert Explicit phrase boundary 
nfarkers in the tree, for use in the PatternTuJorial; „ V/ 

• PLURALIZATION- (3) and'SINGULARIZATION- (3) transformations, which are used in the 
Singular-Plural Tutorial. * t ^ * 

• PRONOMINALIZATION- transformations (14), which pronominalize various noun phrase 
- positions in a sentence, in first ("I am happy"), second ("The boy saw you"), and third 

. (VThe girl ggve him a bdok") persons. 

• Q- ( = Quantifier) transformations (17), .which insert quantifiers such as "some" and 
"every", as well as the numbers from one through ten. 

• RELATIVE- transformations (9), which include all the restrictive relative clause 
possibilities; e.g. relative clause on subject, direct object, or indirect object, with 4he 

, target of relativization either the subject or object of the relative clause. (They include 
transformations to produce infinitival relative clauses, such as "A book to read"'; a£well, 
although the base,structures for these forms do not exisfat present). It is also possible to 
•generate sentences with extrapoeed relative clauses; e!g. "The boy cried who was sad" 
.from "The boy who was sad cried". 



ERLC 



• REQUEST- transformations (72), which create various forms of requests, from stark 

• impeYatives (sudh as^"Open the <£6or!"> tojnore elaborately polite requests (''twould 
appreciate, it if you would op6n the door"). Jhey are primarily used in the Request 
Tutorial. * 

• » * * * " 

• THERE-INSERTION, which produces sentences with existential "there"* fiThere was a 

boy on the slide", "There was a giri crying 11 ). . N ■ ; 

• THIS- (3) and THAT- (3) insertion translormatioi^vhich insert the demonstratives "this" 
and "that". \ . * . " 

* , 1 . ' * - . • i « 

• TOUGH- transformations (2), which "produce sentences such as "This rule is easy to 
ridicule", "It [s easy to ridicule this rule", etc, 

• WH- transformations (22), which produce yes-no questions ("Is the boy running?") as 
well as questiorts'involving a WH-word-(such as "who" or "what"; e.g. "Who is crying?", 

."What did you ?ee?"). It is also^possible to question quantified phrases, producing 
sentenced such as "How many apples did John pat?'* In addition, transformations exist to 

• question genitive phrases (as in "whose book"), even though^geni^ive phrases are not' 
available from the base. v ^ * 

• - • : • 

• WHIZ DELETION transformations (5) of various sorts, which relaje relative clauses such - 
- as "The boy who was on the slide" with truncated forms such as "1 he boy on the slide". 
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The utility transformations include: 

* AFFIX-HOPPMG, wKich insures that the participles following the auxiliary verbs "have" 
and "be" are given the correct inflected form and that the person and number agreement 
marKer in a clause is placfed on the appropriate verb or modal. * 



• COMPA (4) transformations, which insert subordinating conjunctions (or 



Complementizers) such as "that" and "for" into complement clauses 



DET-SOME/ANY-SUPPLETION- (2) transformations, which guarantee that the* correct 
form of the "polarity" item "some" appear? in the appropriate contexts; e.g. as y any" 
after negation. m * 

• DO- (4) transformations, which insert the dummy element "do" in the required contexts; 

e.g. in certain negative sentences ("Dianne doesn't like Chris") ana in various questions # 
("Do you know the answer?"). fc . , 

• NUMBER-AGREEMENT, which pauses the appropriate verb or modal in a clause to agree 

in person and number with the'subject of that clause. 

*• * 

, c 

• PUNCTUATION- (5) transformations, which are used to insert commas in the appropriate 
- places before and/or after "please" in various request forms. 

• SUBJECT-AUX-INVERSION, which is used in the generation of yes-no and wh-questions. 

Base structures can be created which permit the application of all these transformations, 
«x<Jept.as noted above. There also exist* transformations which lack the appropriate base structures, 
although they are few. Such transformations have been tested on manually constructed base trees, ■ 
so it is known that they function correctly. Such transformations include: 

• CONJUNCTION- transformations (14), which allow for the production of various elliptical 
conjoined structures, including conjoined sentences with elided subject ("John likes 
Mary ancf hates Sue"), as well as more complex examples. f 

• EQUI, which generates sentences such as "John wants to go". 

• EXTnAPOSIT|ON-OF-P M -FROM-N ,, l which produces sentences such as "A book came 
out by Chomsky" from "A book by£homsky came out". 

• INTRAPOSITION, -which relates sentences such as "That Bilhwould dojhat seems 
strange" and "It seems strange thai Bill "would do that". % 

'* IT SPELL OUT, ^jicMnsqrts expletive "it" in sentences such as "if seems to be gaining". 
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•PARTICLE-SHIFT, which allows verbal "particles" to shift around the object of the verb, 
as in "He wrote the story down" from "He wrote down the story". - u ' 



• RAISING, which produces sentences such as "John seems to be happy". 



• REFLEXIVIZATION- transformations' (3), which insert reflexives into various noun phrase " 
positions in a sentence under identity; e.g. "John helped John" Hjohn' helped*."- 
himself". ' " 1 \ ' 

In addition' to the transformations which produce -grammatical sentences, there also exist,- 
"mangier 11 transformations which deform the syntactic structures produced by the njialn set of 4 
transformations. These &e of {wo types: those whiqh prbduce\jngrammaticSl sentences found in .foe 
writings of deaf students, (theyare flagged with the suffix -/DEAF); andtKose'which pro'duce various 
deformations of grammatical structures which are not neces?arily characteristic • of 4eaf students 
(they are flagged with the suffix At present thfcre,are40 dfeaf transformations and 20 deeming 
transformations. The constructions for which deaftransformalions.exist*are: \ ■ " v> 



• BE- (5) and HAVE- (2) transformations; wh'ich duplicate, the, c6nhjsion' % and. misuse "qf . * 
these two auxiliaries by deaf students/ /ifi^^and ,< have , ;^re delated by some of these* 
transformations, and, in some cases; aire substituted* for eaph bther^e.g. "The boy h&s* , V 

c ^ running 11 , "The man is a coat' 1 ). * < % ~* *' \. ? f * ^\ K . ^. . 

. •COMPLEMENT- transformations (8), which.combine portions of infiriitlval-ahid gerundive . 
complements in the ways that deaf students dp; e..g.. "The teacher asked the boys to * 
, being nice". \« v * *, •• « 

* ■ l ■ . • . • • 

• CONJUNCTION- transformations (4), /which-, produce deformations of • conjoined • 

•structures. -,% " ^ ■ " /I *' 

• LADV". transformations (2), whiclrconfuse djfferen/types of adverbial phrases." ' * + ** • 



• N"- transformations (4), .which perform vangus' deletions and deformatipns £n notfrv - 
e phrases. * * \ s • 

• NEGATIVE- transformations (6), whfch substitute '/pd" for "hot" and/or move the* 

negative particle to* positions where negation does not.appear in standard English. 

! - s • , * 

• OBJECT-DELETlONi which produces examples such as "The won^an got 41 . ' » 

\ • • -% 

• PROGRESSIVE-DELETION, whicjr produce's examples such as M Jake was run' . ' 

• {RELATIVE-PRONOUN trgnnformation^ (3)^ which "mimic various d?af relativization . 
slratf cjior^ e.g. "Thi; ifiil vfho'Jnke lik's lior is pretty 11 . < rf 
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• WH- transformations (3) and SUBJECT-^UX-REINVERSION, which are used to produce 
typical examples Of deaf question formation. h 

Deforming transformations of the following type exist: 

• -DELETION- transformations (10), which delete various constituents in a sentence. 

• REQUEST-PLEASE- insertion transformations (3), which insert ''please 11 in requests in 
^sitions where it should not occyr. * . 

• -SWITCH transformations (7), which scramble the order of constituents in a sentence. 

Another type oftran&formation is the Post-Cyclic=Transformation. Transformations of this type 

apply after all other transformations have -applied and have as their domain the entire sqqtence 

^normally, transformations are limited to a single'clause of a sentence). This type of transformation 

was created in ordSTTo allow the morphirig process (which produces the inflected form of words 

whose root form appears in the treeTto be done by transformation. This allows ILIAD to retain 

* 

information about the syntactic structure of each sentence generated. This jriformation, in turn, has 
been used to construct Help and Hint mechanisms for various' tutorials, to aid the students. 

Thepo3t-cyclic transformations are divided into the following families: / ^ 

t " \ - 

• MORPH- transformations (14), which produce the correct morphological forms of the 
* * different parts of speech; e.g. the plural forms of nouns, the inflected forms of verbs, the 

correct forms of the perfective, progressive andpassive participles, the comparative and 
superlative forms of adjectives, etc. 

. • PRONOMINALIZATION ^MARKING (4) and -SPELL-OUT (3) transformations, which mark % 
the correct Cases on prpnouns (e.g. NOM[inative]) on Subjects of finite clauses, 
ACC[Usative] on Direct Objects, etc.) and produce the correct inflected forms of * - 
pronouns (e.g. "him" for the Accusative singular form of the third person masculine * 
pronoun). * * . . 

• RELATIVE'-PRONOUN-SPELL-OUT- transformations (2), which proouce the correct 
forms of the relative pronouns; i.e. "who" in relative clauses on a Human head noun and 
"what" otherwise, tf 

• WH- SPELL-OUT transformations (3), which produce the correct forms of the WH 
question words; e.g. "who" or. "what" for the interrogative pronouns which question, 
noun.phrase positions, as well as "which 11 and ;*what" (as in '"which stories 11 ), "how 
many" (as in "how many boys")$hd "how" (as in "how intelligent 11 ), , » 

Figuiu*; 3G and 3-7 show tho stiuctute of a sentam-0 hoforo and after 'the application of the 
tfppropriaUrPost'CyclicTrancloniuitions. x .v 
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S' [ TRANS. 1 ] 
COMP [ -WH 1 

S ? 

N" [ +N -V PER. 3 -DEF NU.S6 +HUMAN GENDER . FEMALE S0CSTAT.2 ] 
OET [ -DEF NU.SG ] 
the 

N' [ +N -V PER. 3 -DEF NU.SG +HUMAM GENDER. FEMALE SOCSTAT.Z' ] 
N [ +N -V PER. 3 -DEF NU.SG +HUMAN GENDER. FEMALE SOCSTAT.2 ] 
girl 

V" [ -N +V +PASSIVE +INDOBJ +TRANS ] , 
AUX [ ClauseNumber.l -NEG ] 4 
V [.-N +V +PASSIVE +INDOBJ +TRANS ] 
V [ -N +V +PASSIVE +INDOBJ +TRANS ] 
V [ -N +V +PASSIVE +INDOBJ +TRANS ] 
ask@ 

TNS [ +H NU.SG PER. 3 +M +A -H ] 
past 

N" - [ +N -V PER. 3 +DEF NU.PL +HUMAN GENDER. MALE S0CSTAT.4 ] 
DET [ +DEF NU.PL ] 
the 

N' [ +N -V PER. 3 +DEF NU.PL +HUMAN GENDER. MALE SOCS'TAT.4 ] 
N [ +N -V PER. 3 +DEF NU.PL +HUMAN GENDER. MALE SOCSTAT . 4 ] 
gentleman 
N'" [ +N -V PER. 3 -DEF NU.SG ] 
DET [ -DEF NU.SG ] 
a 

N' [ +N -V PER. 3 -DEF NU.SG ] 
N [ +N -V PER. 3 -DEF NU.SG ] 
fi ' question 

Figure 3-6: Unmorphed Tree Structure 



3.1.3 Control Capabilities 

In order to manage the creation of the base trees and the application of the transformational 
rules, there are several" layers of control mechanisms. The first of these is a set of constraints that 
direct the operation of the base component and indicate which transformations to try. The base 
constraints were discussed in Section 3.1.1, transformational constraints simply indicate which 
transformations are to be tried and which are to be ignored. There are a number of dependencies 
which exls* among constraints. For example, if the transformational constraint for the passive 
transformation is turned on. then the base component must be instructed to produce a direct object 
and to choose a main verb that may be passivized, if the base constraint for a direct object is turned 
off. then the base constraint lor an indirect object must be turned off a:, well A data base of 
implication}, controls tht? application of constraint:, so tli.it wlit;n.;v. ; r a uoiv.traint io ut\ (or turned off), 
the base and/or transformational constraint!* that it's Vvilue implies are ;ilso set. 
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S' [ TRANS. 1 1^ . 
COMP [ *WH ]• 
S 

N" [ DEF.NIL +N -V PER. 3 -DEF NU.SG +HUMAN GENDER. FEMALE S0CSTAT.2 .] 
DET [« -DEF NU.SG ] 
the 

N' [ +N -V PER. 3 -DEF' NU.SG tHUMAN GENDER. FEMALE SOCSTAT.2 ] 
1 N [~+N -.V PER. 3 -DEF NU.SG +HUMAN GENDER. FEMALE SOCSTAT.2 ]. 
• girl 

V" [ -N +V +PASSIVE +INDOBJ +TRANS ] 
Ap [ ClauseNumber.l -NEG ] ' / 

V [ -N +V +PASSIVE +IND0BJ +TRANS ] \ 

V [ ROOT. ask -N +V +PASSIVE +INDOBJ +TRANS ] 
asked 

N? ' [ +N -V PER. 3 +DEF NU.PL +HUMAN GENDER. MALE SOCSTAT.4 ]" 
■ DET [ +DEF NU.PL ] • 
the 

N' [ +N -V PER. 3 +DEF NU.PL +HUMAN GENDER. MALE SOCSTAT.4 ] 
N [ -NU ROOT. gentleman +N -V PER. 3, +DEF NU.PL +HUMAN 
GENDER. MALE SOCSTAT.4 ] 
\ gentlemen 

TT^ [ DEF.NIL +N -V-PER.3 -DEF NU.SG ] 
DET [ -DEF NU.SG ] * 

a • 
N' [ +N> -V PER. 3 -DEF NU.SG ] 
N [°+N -V PER. 3 -DEF NU.SG ] 
question 



Figure 3-7: Morphed Tree Structure . \ 

But constraints and implications are not sufficient to permit easy specification of syntactic 
constructions. The notion of "syntactic construction " transcends the distinction between base and 
transformational constraints and does not necessarily depend on their implications. One should be 
able to specify a syntactic construction such as passive or relative clause without having detailed 
knowledge of the constraints or their implications. In addition, one might want to request, say, a 
relative clause on the subject, without specifying whether the target of relativization is to be the 

subject or object of the embedded clause. 

j 

The ability of JLIAD to generate different syntactic constructions is greatly facilitated by a set of 
data structures called synspecs (an acronym for Syntactic Specifications). Each synspec contains all 
the information noceosary forJheLOGnetation of 3 given form. Jhis is yseful because even a seemingly 
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simple construction may require the operation of several transformations, as well as particular base 
structure constraints. Each synspec contains a list of the appropriate base constraints and 
transformational constraints, the synspecs that could be 'used to generate a related incorrect 
sentence, and a description and examples-for purposes of documentation, and other synspecs which 
are compatible or incompatible with it. When a synspec is actually "processed*' during the 
generation of a sentence, the constraints take effect so that the desired form js produced. 

Because each synspec is a "specialist" for a single construction synspeGs are-of-great utility in 
both the Playground (see Section 5.2)^ and the tutorials. Since the* number of syntactic constructions 
available in ILIAD now is quite large, it would be difficult for everyone to know all the base and 
transformational constraints for each construction, or even for a large subset of them. Synspecs, 
however, allow a user to generate any desired construction by simply invoking the appropriate 
synspec. *Since synspecs bear mnemonic names, such as "passive-sentence", "transitive-sentence", 
"yes-no-question", etc., it is usually straightforward 'to find the synspec associated with a given 
construction. Moreover, each synspec also contain a description and/or example of the type of 
sentence it produces. Thus, in case the name of a synspec is ambiguous, it is easy to examine its 
^ description or example to determine exactly what sentences it produces. 

Synspecs have also permitted the simplification of individual tutorials. This is due tc the fact 
that various tutorials may generate the same constructions— yes-no-questions, passive sentences, 
various types of relative clauses, etc. Without sjrjjspecs, it would be necessary for each tutorial to 
contain the base and transformational constraints for every construction used in that tutorial. In the 
case 6\ constructions which appear in several tutorials, this information would be redundantly listed 
in each of these tutorials. With synspecs, this information needs to be stated only once— in the 
appropriate synspec. An individual tutorial, then, need only know about those synspecs which 
ptroduce the constructions it needs. Synspec names are also used when a student is specifying the 
kinds of sentences a tutorial should produce (see Section 5,1). 

\ ^ 

In addition to information about base and transformational constraints, synspecs also contain 
other types of information which may be useful in different tutorials. We have already mentioned that 
each synspec contains an example of the construction which it produces. Such Examples may be 
called by the Help system, ir. those tutorials which allow a student to select different construction 
types, when s/he is not ceitain what a given construction is. Various synspecs have a Question for- 
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Student property which may also be used in such tutorials. There is also a Possible-Bad-Things-to-Do 
^property, which associates with an individual synspec one or more synspecs which produce 
corresponding non-standard English sentences. 

A sample synspec is shown in Figure 3-8; the complete list of 251 synspecs is given in the report' 
"ILIAD Data Base Reference". 

pass.iye-sentence 



BaseConstraints 



TransConstrai nts 



\Contradicts 



Level : 



QforStudent : 
Examples : 
PossibleBadThings 



((PASSIVE . +)) 

( ( PASSIVE-AGENT-DELETION 



)) 



( i ntransi tive-sentence 

predicate-adject ive -comparison- sentence 
predicate-adjective- sentence 
predicate-adverb- sentence 
■ predicate-nominal-sentence) 



1 DontUse 

2 UserChoice 

3 UserChoice 

4 UserChoice 

"passive sentences?" 

("John was punished by the teachers.") 

(be-deletion delete-by). 



Figure 3*8: Sample SynSpec 

Finally, it should be noted that there is a special type of synspec, the meta synspec, which, 

rather than setting up base and transformational constraints directly, can call other synspecs* by 

v. 

interacting with the constraint mechanism (which is discussed in Section 5.1).. This is useful in those 
instances, where a construction has various subconstructions, For instance, the meta synspec 
relative-clause will randomly call either one of the synspecs rel-clau$e-on-$ubject or rel*clause-on- 
object. This synspec is useful, then, in cases where a relative clause is required, but it does not 
matter whether the relative clause appears on the subject or the object of a sentence. However, in 
those cases where a< relative clause must appear in one position or the other, the latter two synspecs 
are available. Thus, mota synspecs allow lor tho creation ol more cjeneial construction types, 
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whereas synspecs allow for the selection of specific sub-types of a given construction. An example of 
a meta synspec is given in Figure 3-9. 

question 

Requires : * (yes-no-question wh-question) 

Contradicts : (imperative declarative) 



Level : 



1 UserChoice 

2 UserChoice > 

3 UserChoice 

4 UserChoice 



Figure 3-9: Sample Meta SynSpec 

3.2 Semantic Capability and the Dictionary 

This section will describe the semantic component and the structure of the dictionary. Central 
to the capability of the semantic component is the organization of words jn a hieraichical semantic 
network which will also be discussed. 

3.2.1 Semantics < - 

As*the base component builds the base structure tree, it performs lexical insertion by picking 
words at random from the syntactic category needed in the' tree and then using the semantic 
component to determine whether the selected word Is semantically compatible with words chosen so 
far. In onder to accomplish this task the semantic component is equipped with the following types of 
information: 

1. The selected word together with its syntactic relation to the current situation. 

* < 

2. A list of semantic constraints imposed by a higher syntactic structure which the 
chosen word has to satisfy. For example the word considered as a candidate for 
the direct object of the verb "eat" has'To satisfy the constraints attached to "eat" 
under the direct object label. Those constraints indicate that the candidate word 

0 should belong to the semantic category of FOOD objects. 

3. A list of registers which include syntactic and.senqantic description of ths structure 
constr ucted so far. 
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In addition to the requirement of satisfying semantic* constraints, the chosen word may cause to be 
set semantic registers which convey its meaning. Those registers are then checked againsMhe 
current registers list to find out if they conflict with already existing registers. In a case of conflict the 
process is aborted (i.e., semantics rejects the word) and control returns to the syntactic component 
for another word choice; otherwise the new registers are added to the context and generation 
proceeds. ^, 



EMC 



This mechanism provides the semantic component with a sophisticated way of referring to 
different leyels in the base tree, and thus makes it possible to accept or reject a word on a mor<e global 
basis than the semantic constraints permit. The following example will clarify the function of the 
registers: assuming the verb "wear 11 has been chosen as the main verb of a sentence, its subject is 
tested to verify that it belongs to the semantic category of HUMAN objects. The success of the test 
will invoke the setting of the subject's GENDER register because of its possible relevancy to the 
selection of the direct object. Then, if the word "skirt 11 is passed to the semantic component as a 
candidate for the direct object, semantics will attempt to set the register CLOTHES-FOR to FEMALE 
since skirts are intended for females only. This attempt will succeed only if the GENDER register of 
the subject is set to FEMALE, thus a sentencesuch as "The pretty girl wore a skirt" may be generated 
but "David wears a skirt" is rejected. 

4 The semantic component is also aware of syntactic registers that might affect semantic 
considerations.^ Information about the NUMBER register of the subject and the direct object plays an 
important role when a verb like "ride" is under consideration. We do not encourage the generation of 
odd sentences such as "The boys have eaten .the cookie ! \or "Debbie rides the bikes". Instead we 
generate "The boys have eaten the cookies" and "Debbie rides the bike". Determiner registers 
guides the semantics of predicate nominals: when both the subject and the predicate nominal are 
known to be indefinite, the subject will have io bear a class membership relation to the predicate 
nominal, as in "A ball is a toy" . 

In order to handle the semantics of relative clauses efficiently, the semantic component 
includes a special mechanism for determining if a word cho sennas a^candidajte forji verb in a, lower 
clause is somatically compatible with the main verb in'the upper clause. This is accomplished by a 
"backward" checking where all the semantic constraints of the "new'* verb are checkepJ against the 
corresponding registers in the registers Not. If these new constioints violate any existing register 

a r l ° 
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values, semantics rejects the verb. For example, in generating a relative subject on the subject for the 
sentence "The boy kissed Mary", the verb "cry" will be eliminated because the semantic constraints 
attached to its subject slot specify a negative emotion direction, while the emotion of the subject's 
register has already been §et to positive when "kiss" was chosen. 

•> 

The mechanisms described above provide the semantic component with powerful tools to deal 
with the semantics of the following sentence types transitive and intransitive sentences, predicate 
adjectives, locative adverbs, want complements, that complements and sentences with relative 
clauses The semantics of predicate nominals have been deeply investigated and have turned out not 
to be trivial at all (see the thesis Representation of Nominal Concepts in Semantic Networks: 
Application for Generation of Predicate Nominal Sentences by V. Shaked cited in Section 7.1). 

3:2.2 Dictionary 

The backbone of the dictionary structure is the semantic network which defines a hierarchical 
organization within the world of actions, objects and states. Figure 3 10 illustrates a partial semantic 
network. The semantic network consists o( two components, concepts (IN UPPER CASE) and words 
(Capitalized). Concepts which are the nodes of the network represent sets of words that are closely 
semantically related Ea\h concept may point to its superconcepts and/or subconcepts. Words are 
the "leaves" of the networkVid have links to their appropriate concepts. For example, the words 
such as "boy" and "Bob" are linked to the concept "BOY" which further points to its superconcept 
-CHILD 11 . 

Currently, the dictionary contains about 112 different semantic classes (concepts), 114 verbs, 
121 nouns, 37 adjectives and 9 focative adverbs as well as determiners, modals and other closed- 
class words A complete listing of the dictiorary may be found in ILIAD Data Base Reference". 
Associated with each word are 5 kinds of information: 

1. Parts of speech A word may have more than one part of speech. For example, the 
word "kiss" is a verb and a noun. 

2. Features: Syntactic, semantic, morphological and semantic "actions to be 
executed" are features of words which are processed as a word is added to a 
sentence Syntactic features include such things as + or - passive und + or - 
transitive value*. Morphological features sho* how the Word is to be inflected. A 
link called CXAMPLE/OF indicates that n certain word in an instance, of a more 
(jonoial concept It ilistinrjuislkT, hoUvten the rotation tlutt words hku "dog" or 
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ANIMATE ^ ( NONANIMATE) 



(human^^ 

Person ^ _ ^_ 

:BDtferfK 



Man Woman Dog 

Policeman Lady Poodle 
Mailman Betty Bulldog 
Bill Mrs. Green 

Gentleman 
Mr. Green 




Cat 



Figure 3-10: Portion-of ILIAD Semantic Network 

n cat n haye to the "ANIMAL" concept, and the relation that the word "animal' 1 
bears to the same concept. This link has bteen introduced mainly to assist the 
semantics of predicate nominals. 

3. Constraints: Semantic constraints are specified for the various syntactic case slots 
that a word might have. Much effort has been put in expanding this kind of 
information, and syntactic constraints were taken into consideration too. In the 
event that semantic information applies to a group of words (i.e. concepts) it is 
attached to the concept and is inherited by the words. The fact that nouns such as 
"boy", "man", "girl", can be modified by emotional adjectives, is attached to the 
concept "HUMAN". This way the necessary semantic information is stated only 
once instead of repeating it for each word separately. „ 

4. Complexity: The difficulty level of words can be specified, e.g., Level 1 words would 
include M play" and "happy 0 while Level 4 would include more sophisticated words 
such as "humiliate" and "edible". 

5. Vocabulary Type: The main ILIAD vocabulary is a "Playground" vocabulary 
focusing on personr.. animals, objects, actions and locations associated with a 
children's playground. The purpo^o of multiple vocabuLinor, w to allow the student 
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' * ' *" 

. ^ "> 

# 

to change the topics in the tutorials simply by changing to another vocabulary type; 
changing vocabulary type, however, will have no effect on other syntactic or 
semantic constraints which have previously been set. ILIAD will make it possible to 
focus on grammatical aspects of English in a variety of contexts. * 

As the semantic network expanded and more information was added to the dictionary, we 
reajjzed the need for a routine to control errqrsjh at might occur during tlie input of ne.w_entriesjLcLthe 
dictionary. This word definition routine minimizes the amount of information,typed by the user, and 
interacts with him/her through a prompting process. The dictionary maintenance functions are used 
when words are edited, and it helps keep track of which dictionary files need to be remade. This 
mechanism has made it possible for some people who were not programmers or developers of the 
ILIAD system to enter new vocabulary with a minimum of training. 

3.2.3 More Powerful Semantics ° 

The semantic network described above constrains the sentence generation of ILIAD so that 
anomalous sentences are avoided. But a problem arises when more than one clause is generated, 
whether in a single sentence (e.g. a relative clause) or in a sequence of sentences. The clauses are 
essentially independently generated (although clauses within a single sentence must satisfy inter- 
clausal constraints), so they are not necessarily semantically related. A sequence of such clauses 
can seem npn-coherent to the ILIAD user even \vhen each sentence is acceptable itself. 

3 

« Another problem with simple network semantics arises because the semantics operate 
essentially as a filter. Out of the universe of syntactically acceptable strings, it rules out only those 
which are strongly semantically anomalous. This can cause a problem with efficiency, since backup 
may be needed before a semantically acceptable string is found, and ft can also generate subtly 
peculiar sentences such as u The fire chief writes the story" which is certainly not anomalous, but 
which is a bit unmotivated. 

* 

" To deal with these problems, a new semantic system was designed which allows representation 
of more information, including both general semantic knowledge and representation of specific real- 
world situations This system is based on the knowledge representation language KLONE, with both 
deletions of substantial portions of the present KLONE system and a few extensions appropriate to 
the language generation domain. 

* ♦ 

The- KLOMK son. mtic return uses the basic ron.stiuctr, of CONCL'PT (ou.unti.illy a Mrtittuiedr 
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object), SUPERC (for hierarchical relations), and ROLE (for arbitrary structured relations).. Syntactic „ s 
processing is facilitated by the addition of SYNCQfclCEPT (syntactic concept) nodes and POS (part of 

speech) links. While these syntactic types could have been included as instances of other KLONE 

. ' <t 
nodes and links, their separation from the semantic information partitions the network and reduces 

v . 

the size of t^e search spac§ when accessing network information. . , 

~Tfie problem witff QffnrotiVated"sentences iS"dealtwitfrby-the"RObE links. Each ROLE specifies 

3 relation between objects or classes of objects (e.g. A person has a height, or Jim is 6 feet tall). 

* 

These ROLEs contain exactly the information which we are likely to want to generate, so we can 
search the lisT^ROLEs to determine candidates for generation rather than picking random words 
and then checking for anomalies. The semantic system can also mark the information associated 
with ^ ROLE as obligatory or optional and may indic.ate how this information is to be expressed (e.g. 
an agent of an action might be marked as obligatory, expressed as grammatical subject), ft may even 
mark the information as known but not usually expressed (e.g. every person has a head). x * 

The problem with multiple clauses is also relatedlo the lack of sufficient information in ordinary 

semantic networks. . ROLE information is one type of missing information, but more important for 

multiple clause coherency is the notion of specific (real-world) information. KLONE distinguishes 

between generic and individual concepts, and between role definitions and role fillers (essentially 

generic and individual roles). The KLONE semantics uses this distinction to separate general 

information (e.g. a boy is a child) from specific information (e.g. .Fred is tall). A collection of specific ' 

information (e.g. a set of facts making up a ctescription, or a set of actions makinqpfStwy) is called an , 

instance. Sentence generation is done using the information making up trte instance, so thafeach 

sentence wilPbe related to the same set of facts, and the set of sentences will exhibit greater 

coherence. • 4 

♦ 

An instance describing a particular situation can be hand-coded, but in this case the sentence 

generation would be limited to exactly the participants and specific actions coded, reducing the 

■ flexibility of generation which is a major feature of th& ILIAD system. To exteijd the generation range, 

* ♦ f " 

a new level of description, called the scenario, hjaSoeen included in the KLONE semantic design. A 

Scenario is a structured collection of information whiwh includes generic as well as specific facts. For 

example; an instance (flight be [Joe chase id Mary. Mary cried.], while a related scenario could be [Ar x • \^ 

' butt/ did a negative action to a person. That person 'cried.] Using scenarios, .a wide variety of 
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sentences can be generated, while still maintaining the, coherence resulting from the use of 
Jnst?nces. This is achieved by instantiating a scenario and using the resulting instance for generating 
a set of sentences. When an unrelated set of sentences is to be generated, a different instantiation 
can Be used. This instantiation is done by combining'the information from the scenario (e.g. .A bully 
did a negative action) with specific and generallnformation coded in'the network (e.g. Joe is a bully. 
To chase is a negative action.) *" ( 

, ^ v : • * - - ♦ • 

,.The use of specific instances for generation also helps with some problems relating to 
• ** * • * 
- reference. In the network-based semantic system, choice of definite or indefinite articles is made 

randomly, and pronominalization is triggered by use of the same word a second time^ In the KLONE 

semantics, each* word has a referent in the KLONE network, and the referents can be marked 

according to whether they have been expressed, so an indefinite article is generated when an object 

not previously mentioned is used, and a definite article when the object is marked as previously 

expressed In a similar way, pronominalizatiorf could be triggered by identity pf referent' rather than 

jdentityof word. • 

> • * 

Many of the ideas for the KLONE semantics have been implemented in the MicrolLIAD system. 
A small KLONE network was used, containing both general and specific information, and sentence 
generation demonstrated the ability to use the general information to create a variety of sentence 
forms to describe a 'single action, as well as the use of reference markers 'to handle definite and 
indefinite .articles. The major •part" of the design which has not been implemented is the use of* 
scenarios and instantiation, as all present MicrolLIAD instances have been hand-coded. * 

* - 



35 



Report No. 4771 • * . ' Bolt Beranek and Newman Inc. 



4. The Language Teaching of ILIAD 

The language tutorials mediate between the sentence generating mechanism and the student. 
Thus, after the student makes.choices regarding sentence complexity, a "prescription" is passed to 
the sentence generating mechanism which determines the complexity of sentences to be generated 
for a particular tutorial. A fundamental principle of ILIAD tutorials is to provide the student with as 
much control as possible over the content of each tutorial session. This requires a control 
mechanism which allows the student to make all sorts of specifications as to the type of sentences to 
be generated, without falling Jnto the trap of making invalid or contradictory specifications. This 
meqhanism takes the burden off the student of understanding precisely what each type of 
specification entails or prohibits and in so doing frees the student to experiment and try out new 
sentence types. This, in turn, leads to greater .variety in the tutorials and greater student interest as 
well sis a fuller use of the system. 

/ ' 

! ILIAD has several language tutorials which are described below in detail. The examples given 
were all produced in actual use, though the interactions have been slightly edited for Brevity and' 
^clarity. 

4J1 General Tutorial Features 

! The tutorials are all designed to to appeaV as uniform as possible to the student so that the 

interaction remains familiar no matter which tutorial is being used. This section discusses those 

h 

fealures which are common to all'the tutorials. * '+ 

• . ' " ' - . \ < « ' . " • \ • ~ 

4,1,1 Levels 

The tutorials have four different levelfc of difficult^, which the student can choose among. As 
the difficulty level increases the range of possible sentence types increases d^d this in turn allows the 
student a greater variety of sentence types to work with. For instance, sentences involving relative 
clauses are only presented at the higher levels/ ' • 

In addition to the difficulty level, the student can also specify one of four vocabulary'levels, 

ranging from very simple words to those which a deaf student might not be expected to know even at 

» * * * 

the high school level. This governs the types of words that the tutorial will make use of in the 
sentences it produces and inlhe comments rt makos to the student. 
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These two Jevel specifications give the ILIAD tutorials the potential to be used by a widely 
differing range of students from the ve«y naive to the quite sophisticated In addition, as a student 
progresses and begins to master one level s/hekan simply increase the level of the tutorhi'and*t>e 
freshfy stimulated with more complicated sentences. The ability to control the v^pabulary level 
independently of the syntactic level makes it possible for a student to experiment with these variables 
in ordeP to find the combination.that s/he is mo$t comfortable with, as well as permitting the overall 
complexity of the sentences produced to be increased very gradually. 

The following transcript shows a student's interaction with ILIAD. 

ILIAD - Version 6 , 

! 

* 

What Is your name? >s \ \ 

>jack , 

Thanks, Jack. ^ 

[The student's name is remembered for later use. Now the set ol possible* tutorials is 
shjown.] 

r ^ • 

You can... - 

1. decide whether sentencos are good or bad * 
2,. play with singular and plural sentences 
, 3. make questions v " * 

4. match sentence patterns \ % 

6-. learn how to use Please ' * 
6. learn about polite requests 

Do you want 1, 2, 3, 4, 6 or 6? 

>3 , 

, * You can soe, 

1. short sentences * 

2. ^medium, sentences 

3. long sentences 

4. very long sentences * 

% * g 

Do you want*l, 2, 3 or 4 ? . 

[This is the syntactic level choice.] " 
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The sentences can use*.. 

1. very easy words 

2. easy words t 

3. * medium words 

4. ,hard words 

♦ ■ 

Do you want 1, 2 t 3, or 4 ? 

> 4 * , 1 . < 

• [This is the vocabulary level choice. At this point, ILIAD branches to the particular tutorial 
that was chosen.] , 



4.1.2 Messages^to the Student 

* : % 

Congratulatory messages are printed ig response to a correct answer.by (he student. The e*act 

o 

message printed depends on the level that the student j s working at and sometirrles includes the' 
student's name. This is intended to make the tutorials friendly and to hold the student's interest so 
that asophisticated.student is rewarded with stimulating and unusual messages. On the other hand, 
the messages- given in response to'a wroncj^answer are short and direct so as not to reinforce t 
incorrect answers; these too vary depending on the syntactic level selected by the student. 

4.f.3 Uniform Commands^ * - * v 

To make the ILIAD system as' easy as possible to use for students who are not necessarily 
familiar with computers, it was decided tQ make the entire student interaction uniform and 
homogeneous in the sense that* all points of interaction will hflve the same request* format and 
standard options for student input. This was achieved by having one function that controls the 
.student interaction. This function can h$we many different types of arguments so that it Cctn^e made 
to expect j)ne of three types of input from the student: (1) a sentence, (2) one word, (3) some option 
from an options list. * . 

The uniformity is in the standard options that can always be typed by the student to the ">" 

*■ * 
prompt. Thus the student has to know only Jhese few standard options to be able to use the system. In 

fact, the student has only to remember one, the question mark, since typing that will show atl the other 

available options. * * , 

The standard options which are always available are to end the lesson, to send a message to 
the system developers (this feature has boon very unoful for conveymy sugy^tionr, and bug ropurtr* 
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* to the programmers responsible for maintaining the system), to change the student's<choices about 
the kinds of sentences to be produced, to repeat the most recent question, and to get help or a hint. 

* 

If the student uses the Help option, s/he is -given a message that provides some useful 

4 

information relevant to that particular, point in the system. For example, when the system asks the 
Q student if s/he wants to see negative sentences and the student not knowing what is meant by 
negative sentences, types Help to find out, some examples of negative sentences are given and then 
the > prompt is given again: | 

Do you want to see . • • 
negative sentences? 

^ * Here are some examples to help you. 
The apple Isn't good. 
John did not see Mary. c - 
> 

*At this point, Help messages have not been built into all parts of the system. However, the Help 
mechanism has been set up so that adding those various messages is now a simple matter. 

If the student chooses the Hint option, s/he is given a hint relevant to that particular point lYTth^ 
system. This is similar to the Help option above, but can be more specific. 

Since the ILIAD system has extensive "knowledge" of syntax which it uses to build a sentence, 
it can use this information to further instruct the student. The Help and Hint mechanisms do just that. 
k Thus, they can provide information as to the various syntactic parts of a sentence, sudh as what the 
subject or object is, or information concerning the verb and how to change its tense. This use of the 
Help/Hint mechanism will be illustrated in the tutorial examples below. 
I 

4.1 .4 Syntactic Choices 

The synspec constraint mechanism allows the tutorials to make full use of the wide variety of 
. sentence types that the sentence "generating component can generate. The constraint mechantem 
was necessary to ensure that only sentences desired by th£ student 'andVtfpplicalle to each tutorial 
were generated. The constraint mechanism allows the, student to specify various choices to control 
the typos of sentences that are generated within each tutorial The student is pigmented with a set of 
choices of syntactic structures Hie elements of which are detei mined by the syntacticlevel s/he lias 
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already chosen. The student can choose any number of these structures, and can refuse any number 
of them as well. As* the choices are made, the set of subsequent choices expands and contracts so 
that at all times ILIAD displays only choices which are compatible with the tutorial, the student's 
previous choices, and the current level of syntactic complexity. The choices made by the student 
remain in effect for the duration of the tutorial, but before each sentence is generated the tutorial 
makes further random selections to produce a variety of structures in the exercises. Additional 
explanation of the constraint mechanism is given in Section 5.1. 

4.2 Sentence Judgement Tutorial 

The judgement tutorial generates sentences of various syntactic types and requires the student 
to judge whether the sentences are grammatical or not. The major syntactic constructions used in 
the tutorial, include negation, yes no questions, wh questions, and relative clauses on the subject and 
object; the use of these constructions is governed both by the syntactic level chosen by the student 
and by requests for specific types of sentences. 

The judgment tutorial shows the full power of using a transformational model in that it is 
possible to generate so-called "Deaf English" sentences. This means that the tutorial can present 
sentences that are incorrect in a way that is typical of the types of mistakes that deaf students make. 

An example of an interaction in this tutorial is the following: 

SYNTAX TUTORIAL - you will decide whether sentences are gocnd or bad 

Now you will choose the kind of sentences you want. 

Type choices to see additional choices; type go when finished. 

(Thg constraint choice mechanism illustrated here was implemented in the last six months 
of the project and an appropriate student interface has not been r!aveloped. The system 
appropriate for student use would present examples to communicate choices rather than 
a list of linguistic terms.] - 



declarative * 
question 

predicate -nominal -sentence 

negatlvo-sentonce 

>>declarat1ve 

»go 



Imperative 

predlcate-adjectl ve-sentence 

predicate-adverb-sentence 

relative-clause 
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Ok. Now we will start I 

1. - The bullies bought Mary a baseball. 
Is that sentence good or bad, Jack? 
>... 

I can't wait any longer, Jack. 

o 

[The tutorial is designed to wait a certain amount of time.at which point, if the student has 
not responded at all, the correct answer is given and the next exercise is presented.] 



You can say 



The bullies bought Mary a baseball. 



2. The child stays on the bike. 
Good or bad. Jack? 

>good 

Absolutely right I 
You can say 

,The child stays on the bike. 

3. The g1rls~w111 no send the clever bijlly a baseball. 
Good or bad, Jack? 

>good 

That was wrong. 
It could be * 

The girls won't send the clever bully a baseball. 



4.3 Question Tutorial 

r 

The question tutorial generates statements and asks the student to change them to yes-no or 
wh-qjjestions. The student J termines the complexity of the statements the system creates, choosing 
whether or not to include such sentence characteristics as negatives and, if working at a high level, 
relative clauses. 
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[In this example, the student chose to work with yes-no questions at level 1 with 
vocabulary level 1.] 

1. The kid was smiling. 
Make a yes-no question. 
>was the k d smiling 

[Note that the student does not have to have the correct capitalization or punctuation to 
, have the answer judged correct.] 



Good thinking 1 
Yes, the kid was smiling* 

I. The coats stay on the sled. 

[Here the student requests the complete answer by typing **.] 

Do the coats stay on the sled? 
Yes, the coats stay cn the sled. 

3. Pat wf<s smiling. 

[Now the student will request one word of the answer at a timg by typing a *. The italicized 
portion of each line was typed by the system.] 

>Was • 

>Was Pat • 
>Was Pat smiling? 
Yes, Pat was smiling. 

4, The boys played. 
>d1d the boys played 
>Did the boys play 
Good thinking, Lynl 
Yes, the boys played. 

6. The toy was new, 
>h1nt , V 

Type in a YES*-N0/quest1on. 
>was the' toy new? \ *K 

Super! . • 

Yes , the toy was new. 

[In the following transcript the student chose to work with wh questions on the object of 
the sentence, at levd .4 witti vocabulary level 4. Notice that the congratulatory messages 
are more complex? than those given above.] 
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1. The adults brought Ms. Brown a dog. 
Make a WH-questlon about the, object. , 
>what did the adults bring Ms. Brown? 

A worthy effort, Lyn! 

2. The boys loved a woman. 
>•* 

[The student requested that the whole answer be displayed. Since she did not complete 
the answer herself, no congratulation is given.] 



>Who did the boys love? 

3. The old teacher will mall Mr. Green a letter. 
>• 

>What will tht • 

>What will the old teacher mall Mr. Green 
Prodigious! 



4. The old fire chief got the woman a pet. 
>what did * 

>Miat did the • '• 

>What did the old • 

>Uhat did the old fire • 

>Uhat did the old fire chief get the worman 

>What did the old fire chief get the woman 

Superior! 

6. Jane wrote Andi a letter. 
>h1nt 

Ty|)e )in a WH question. 

>what did Jane wrote Andi? 

>What did Jane • 

>What did Jane write andi 

I couldn't have done it better myself! 

J 

[The following examples were taken from a session in which the student wanted to work 
on wfvquestions about the subject of the sentence, at level 1 with vocabulary level 4.] 





1. Kevin was smiling. 

Make a WH-quostion about the subject. 

>whb was smiling? 

Super! 




A n 
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2. The boy wasn't skipping. 

Make & WH-quSst1on about the subject. 

>who wan't skipping?* 

>Vho wasnt ^ 

>Who wasn 't skipping 

Super I 

3. Nan didn't lock the gate. 
Make a WH-quest1on about the subject. 
>who didn't lock the gate? 
s N1cei 

4. The poodle wasn't barking. 
>• 

>What wasn't barking? 
Super. \ 

-.5. Dr.<<HJn$k1 was riding the bike. 
>who was 

Who was riding the bike? 



4.4 Subject-Verb Agreement Tutorial 

The subject-verb agreement tutorial asks the student to change singular subjects to plural, and 
vice versa, and to make the appropriate morphological adjustments to nouns and verbs. The student 
may also control the syntactic complexity of sentences in this tutorial. 

4 

Here is an example of the interaction in the singular-plural tutorial where the difficult level is 
set at 4 and the vocabulary level is set at 2: * 1 

SINGLE/PLURAL TUTORIAL - You will change sentence*. 

Now choose the kind of sentences you want. 

Type choices to see additional choices; type go when finished. 

trans 1 t1ve-sentence-w1tN- Indirect-object 

predicate-adjective-sentence 
pred1cate-adverb-s%ntence pred1cat&-nom1oal -sentence 

negative- sentence * relative-clause 
»pred1cate-nom1na1 -sentence 
»go 

Thank you* Now we can start. 

• 43 ' 
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Here 1s a sentence with a singular subject: 

1. The cat has been stolen by the child who Mr, Green tripped. 

Now type 1t with a plural subject: 
>The cats has been 

[The student typed part of the sentence followed by a return. The tutorial only accepts as 
much of sentence as is correct. Thus it echoes back only u The cats". Now the 
student dofesn't know what was wrong with the other part that s/he typed so s/he* types 
"hint" to get some clue.] 

>The cats hint 

[The tutorial gives the student the information that the verb might also have to be changed 
and also tells the student what the verb is. This is only supposed \o be a clue to keep the 
student thinking.. It is not intended to give the answer away.] 

The verb, "has been stolen 11 , may a;]so have to be changed. 
>The cats have been stolen by 

[The student tries changing the verb and then types a return to. see if that was correct. 
The student then realizes that the resf of the sentence remains unchanged, and types 
to save typing by having the tutorial complete the sentence.] 

>The cats have been stolen by ** % » 

the child who Mr, Green tripped, ^ ? 

( • 

The singular-plural tutorial best demonstrates the Help system, showing how the tutorial can 
use its knowledge about.the sentence to provide the student with information that is relevant to that 
tutorial. In this case, it is able to tell the student what the verb is and can remind the student that the 
verb may have to be changed so that there is number agreement. This type of knowledge concerns 
syntactic structure. The next example shows that the Help system can also use its knowledge about 
the morphological information in the dictionary. 
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Here 1s a sentence with a plural subject: 

2. The adults have been. baking Jay a cake. 

• * # 
Now type U with a singular subject: 
>h1at 

The subject 1s: the adults 
>help 

To slngularlze "adults", drop the ,, s M from the end of the word. 

>The adult has been baking Jay a cake. 

Terrific! 

4.5 Pattern Tutorial 

The pattern tutorial was created at the specific request of teachers at the Boston School for the 
Deaf ILIAD generates sentences according to the five sentence pattern types in the Rhode Island 
School for the Deaf curriculum, which is in use at the Boston School. The student can determine the 
syntactic complexity of the sentences and also the number of different pattern types that will be 
generated within one session. At the Hint command, ILIAD displays the sentence broken into 
constituent parts. ; * 

• • * 

The pattern tutorial demonstrated that it is a relatively simple task to prpduce a tutorial which 
conforms to the specific needs of students. The tutorial wag tailored so as to use the terminology with 
which the students ara familiar. This tutorial also makes use of ILIAD'S detailed knowledge of the 
structure of the sentences it generates. Thus it k possible foKthe tutorial to give the breakdown of the 
sentence to aid the student in identifying the^tattern. 

The following example shows the mteraction in the pattern tutorial: 



PATTERN TUTORIAL - you will identify sentence patterns. 

Choose which sentence patterns you want. 

1 - PATTERN 1 N V 

2 - PATTERN 2 N V N 

3 - PATTERN 3 - N LV(be) Ad j * 

4 - PATTERN" 4 N LV(be) N 

6 - PATTERN 5 N LV(be) when/where 



1, 2, 3, 4. 6 or All ? all 
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.1. The banana will be sweet. 
What type 1s that, Jack? \ 
> 4 

No, Jack, look at 1t again. 
The banana / will be / sweet. 

Jry again, Jack* 
>3 

Nice going I 

2. The man was unhappy, . 
What type 1s that, Jacx? 

>3 ( 
Well done! 

3. Bette will make up the story. 
What type 1s that? 

>h1nt 

The sentence parts are: 
Be tie / will make up / the story. 

>patterns 

[If the student forgets what the sentence patterns are, s/he can see them again by typing 
' "patterns".] 

Remember the sentence patterns. . . 

PAtTERH 1 N V 

PATTERN 2 N V N 

PATTERN 3 N LV(be) Adj 

PATTERN 4 N LV(be) N 

PATTERH 6 N LV(be) when/where 

Bette will make up the story. 

What type 1s that? 

>2 

Absolutely right! 

4. Jay hugged Mary. 
What type is that? 
>6 

No, Jack, look at it again. 

Jay^ / hugged / Mary. \ 



Answer 1t again, Jack. 
>2 

Nice going! 



so 
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5: Bill was kind. 

What type Is that, Jack? 

>3 . fc 

Gqpd going 1 

6; K1m tripped the kids. 
What type 1$ that, Jack? 
>2 

Are you a genius?' 



7. The man win be happy. ,' 

What type 1ft that, Jack? j 

>6 . 

WRONG I . ■ 

The man / will be / happy. 

Try again, Jack. J 
What type 1s that, Jack? I 

>* ! 

Wrorrg again. 

Th* correct answer 1s PATTERN 3 

[Since the student got it wrong twice the correct answer is given.] 



\ 



* 

\ 



8. The old toy 1s on the cement. What type 1s that? >score , •« 

^ $ . % 

' [The student can ask \6 see his/her score so far by typing "score" J 

Your score In the PATTERN TUTORIAL 1s as follows: 

6 right. 1 wrong. 0 answers given by the computet* • 

7 total presented. * % / ^ 

[The column "answers given by the computer" refers to situations where the student 
didn't respond at all within a certain amount of time at which point the system gives the 
student the right answer.] 

4.6 Politeness Tutorial 

ThepoA/e/iess tutorial is set up $p that the student is presented with a situation in which some 
person wants somebody else to do something This is followed by a request that might be used in that 
situation. The student has to identify the politeness level 'of thai request. The various levels are 
BOSSY. STRONG. POLITR and VERY POLITE For example, if ono wanted Mary to-open the door, 
r,oii 1 posmhlo roqu«"it form-, nr^ as follows: 



ERIC 



'ID 



Bolt Beranek and Newman Inc. Report No/4771 



Np/477 



BOSSY WAYS -> Open the door! 
» You open the door! 

STRONG WAYS -+ Can you open the door? 

Will you open the door? 

Open the door, please.' S*f 
Please, open the door. - f 

v POLITE WAYS -* Please, can you open the door? , 
Can you Mease open the door? 
Can you open the door, please? 
VERY POLITE WAYS -+ I would appreciate it if you would open the.door. * 

Would it be possible for you to open the door? 

Of course the various politeness categories are not absolute, but they are designed to at least 
give the student a feel for different categories. 

The politeness tutorial demonstrates that a tutorial can exercise a student in the functional 
aspects of language as opposed to the purely syntactic. It is deigned to give the student a feel fof 
the subtlety of the various ways requests can be made and the realiVy of using language to elicit some , 
response from another person. This tutorial has a very large set of request forms which are 
applicable to the real world and which can easily be expanded to include various regional ■ 
expressionSand slang. ; 

- Here is an example of a transcript, in which the student selected long sentences (level 4) and 
medium vocabulary (level 2). ^ 



POLITENESS TUTOR iA - You win judge the pol1tori«ss of sentences. 
Requests can be^SSY, STRONG, POLITE op VERY POLITE. * 
Here are some requests. 

Are they DOSSY,' STRONG, POLITE op VERY POLITE? 

Type b for BOSSY, s for STRONG, p for POLITE, v for VERY POLITE. 
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1. Greg wants a kid to 'help Dr. Johnson. 

He says., '"You help Dr. Jofinsonl" 

Is he being BOSSY, STRONG, POLITE or VERY POLITE? 

>very polite 

VERY POLITE 1s way off, George." 
Grtfg 1s being more direct. 
Try again. 

* 

>strong 

You can do better than thatl * 
Greg 1s being BOSSY. 

[Note thaUhe message? given attempt to direct the student toward the right answer by 
indicating whether the original answer was close ti> the correct one or not The same 
basic situation is used to generate exercises until the student requests a new basic 
sentence< This permits the student to see'many different ways o{ framing the same 
request.} ^ * * 

* 2. Greg wants a kid to help Dr. Johnson. 
He says, "I would be happy 1f you woulcThelp Dr. Johnson." 
Is he being BOSSY, STRQNG, POLITE or VERY POLITER * 
>very polite 

W111 wonders never cease? 

3. Greg wants a kid to help Dr.. Johnson. 

He says, "Woyld 1t be possible for you to help Dr. Johnson?" 
Is he being BOSSY, STRONG, POLITE or VERY POLITE? 
>po!1te 

I couldn't have don* 1t better myself! . 

4. Greg wants a kid to help Dr. 'Johnson. 

He says, "Can you please help Dr. Johnson?" 

Is he being BOSSY, STRONG, POLITfc or VERY POLITE? 

>new-SQntence 

Ok, we will make a new sentence. 
F1rs^ finish this one. 
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He^sayfc, "Can you please help Dr. Johnson?" 

Is he being BOSSY, STRONG, POLITE or VERY POLITE? 

>bossy 

Shape upt 

Grig 1s being POLITE, . , > 

* [The tense and pronouns used in all parts o( the interaction agree with the'basic sentence 
that was generated. This illustrates that the tutorials- can use detailed syntactic 
information about parts of the sentences.produced15yThe generator.] 

# * 

5. Nancy wanted the kid to get the sad lady*a yellow apple. 
She said, "It wouldn't be so hard-tQ get the sad lady a 
yellow apple now, would 1t?" 

Was she being BOSSY, -STRONG, POLITE or VERY POLITE? 
>pol1te 

I couldn't have done 1t better myself I 

6. Nancy wanted the kid to get the sad lady a yellow apple. 
She said, "Please, would it be possible for you to get 

the sSd lady a yellow apple?" 

Was she bfclng BOSSY, STRONG, POLITE or VERY POLITE?*.. 
>very polite 
You got 1tl!l 



4.7 Please Tutorial 

The please tutorial presents the student with a request and requires the student to insert tho 
word PLEASE in the appropriate places within that request This tutorial also includes sentence 
forms which do not take PLEASE, to ensure that students realize that PLEASE cannot always occur at 
the beginning or end of requests. To minimize the amount of typing by the student, all s/he has to do 
is type a sequence of the characters "W" and "P M ; W causes the next word in the sentence to be 
printed, P causes the word PLEASE to be printed If the student makes an error. XXXX is printed and 
the student can trv again After the PLEASE has been inserted, the rest of the request is given, since 
there is no poinftn slavishly completing the request once the-point where the PLEASE can be inserted 
^' has been found. 

»? 

For sentences with moclals there are three places where the word PLEASE can be insetted to 
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Please could you open the door? - 
Could you please open the door? 
Could you open* the door » please? 

For ordinary commands there are two places PLEASE can be inserted: 

Please open the door! 
Open the door, please! 

For longer or more round-about requests there is usually Only one place that PLEASE can be 
inserted: 

» * I would like you to open the door, please* 

For some sentences PLEASE cannot be used at all: 
You open the dopr! 

Here is an example of one exercise: 

1. Would 1t be possible.for you to grease the bicycle?' 

(The student types WWWWWWWWWWP but sees the following line print out.] ^ 

>Would 1t be possible foj> you to grease the bicycle,, please? 
There 1s 1 more way to add PLEASE to this request* 

[Here the student just types "P", ILIAD types the- rest of the request.] 

j >P1e*se, would 1t be possible for you td grease the bicycle? 
That's right! 

2. WMtb ',ie sad bullies a story! 
* [The student types P.] 

>Please, write the sad bullies a story! . * ^ 

There 1s 1 more way to add PLEASE to this request* 

[The student types WWWWWWP.] 

>Wr1te the sad bullies a Story, please! 
Prodigious! 

3. I want you to tell the teacher a sad story. 

>Ploaso, J want you to tell the toachor a sad story. ^ 
Thoro 1s 1 more way to add PLEASE to this roquost. ^ 
>I want you to tell the teacher a sad story, please. 
Coimnondable! 
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4, Could you help? 
>P1ease ( could you help? 

There an *. mare ways to add PLEASE to this request* 
>Cou1d you please help? 

Thtre 1s i more way to add PLEASE to this request. 
>Cou1d you help, please? 
W111 wonders never cease? 
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5. System Development Tools 

5.1 Constraint Mechanism 

The constraint mechanism in ILIAD is a highly flexible device for specifying which synspecs 

should be used to generate sentences for tutorial exercises. As choices are made, a context is 

created incorporating the various relationships between transformations; these relations have to do 

with which transformation^ can co-occur and which have dependency relationships since some 

transformations cannot apply unless other transformations have modified the underlying sentence 

structure. The rules\which determine just how the specification- of some syntactic choice will affect 

the context depend very much on th§ relationships among the choices previously made. The data 

base of synspecs contains all the possible syntactic choices and the relationships among ^hem. The 

relationship^ between any two synspecs in the data base can to be expressed in terms of a few 

primitive relations. The constraint system "knows" about these primitives and determines the effects 

of making a syntactic choice. It is this part of the constraint mechanism that is easily extended or 

, modified, since new primitives can be defined and new functions which know about these prirrfitives 

can be integrated into the constraint mechanism. 

■„ + 

5.1.1 Relationships between Synspecs 

There ^re certain inherent end desire?! relationships that exist between synspecs. For example, 
certain synspecs such as passive-sentence and intransitive-sentence are mutually exclusive while 
others have more complicated relationships involving several synspecs. j _ 

All the .relationships between the synspecs have been worked out and detailed. This 

information is part of the definition of each synspec. Thus, each synspec has information as to what 

other synspecs it conflicts with, expects to be enabled with or involves in some way. 

# * 

In order to specify these relationships in a concise and adequate way, a "language" was 
defined which had to be powerful enough to capture all the possible rela^nshios that might arise 
between synspecs. This "language" must have-enough power, in terms of the primitives that make it 
up. to enable all the necessary relationships that are required for the particular set of items to be 
expressed and at the same lrme.it must be simple, so that thos * relationships can be "coded" into it 
without requiring a detailed Knowledge of tho internals oHho constraint system. 
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The language is made up of the following three primitives: 

1. 'contradicts* 

X 'contradicts* (Y p Y 2 , Y n ) is defined as meaning that syhspec X cannot be 
chosen together with any of the synspecs (Y p Y 2 , ... Y n ). 

yes-noquestion 'contradicts* (question-onobject question-on-subject) 

because a question can only be of one type. 

"'"his does not imply, that for each Item Y } for 1 <i<n there is a corresponding 
relationship in the data base of the form Y, *contradicts* X for each i 1 < i < n. That 
is, an item X can contradict anojher item Y without it necessarily being the case v 
that V contradicts X. However, in most cases this will not be the case and items will 
mutually contradict each other. 

2. *aliows* 

X 'allows* (9 V Y 2 , Y n ) means that if synspec X is chosen then each synspec Y f 
1< i < n is now a possible choice to be offered. 

• m 

e.g., passive-sentence *alfows* agent-deletion ^ 

" If passive is chosen then it is meaningful to specify that the sentence should have 
agent cleletion; making the difference between; 

The cookie was eaten by the boy 
The cookie was eaten. 

The possibility of agent-delelion must be presented only c afte^it has been specified 
that the sentence is to be passive, but agent-deletion does not have to be chosen 
merely because it is a possibility. 

3. * requires* , 

X Requires* (Y P Y 2 . „. Y n ) which means if synspec X is chosen then at least one of 
the synspecs Y, 1< i < n must be chosen. . - 

• * e.g., question 'requires* (question-onobject, questionon-subjectr yes-no- 

question) 

5.1.2 Actipn of the .Constraint Mechanism 

The constraint mechanism starts off with a smalt subset of items tnat can be chosun at the top 
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level. As choices are made new choices are presented to the student and some other choices are 
removed from the student's range of choices. When the student has finished specifying his/her 
choices, the^ystem might make some further choices depending on the set of options remaining. 
The sentence generating system will make choices in the same way as the student, using the same 
constraint mechanism, so that conceptually there is no difference between the student and the 
sentence generator making various specifications. All the constraint mechanism is concerned about 
\te that valid choices are made, but who chooses them is irrelevant. 
The prograhi works with three sets: 

• CHOSEN, which includes the choices chosen so far. 

• PRESENTED, which includes all the choices that can be chosen at some point. 

• EXCLUDED, which includes all the choices that can no longer be^chosen. 

When a new choice is made it is added to the set CHOSEN and removed from the set 
PRESENTED. Any choices that are now able Jo be presented as a result of the new choice are added 
to the set PRESENTED. Any choices that are now disallowed for any reason as a result of the new 
choice, are removed from PRESENTED (if they were in PRESENTED) and added to the set 
EXCLUDED. - 

5.1.3 Efficiency Considerations 

The total number of synspecs that are used by the constraint mechanism is about 250. Since 
this, is a fairly large set it is important that the constraint mechanism be efficient in terms of the 
amount of work it has to do to compute the state of the world after a synspec is chosen. The access 
' methods for the data base of synspecS and their relationships must be fast and efficient. These 
efficiency goals have been achieved. The amount of wortfdone after each choice is not dependent 
on the size of the data base of synspecs. 

5.2 The Syntactic Playground 

As one side effect of the development of the generative system, we have built .a debugging 
* environment called Ihe syntactic-playground in which a linguist or programmer can develop and lest 
various components of Ihe sentence generator. This environment is more useful than tiro tutorials in 
testing syntactic h)poth«r.i»<; and exploring the poAAr of the generator. Usiny the playground 
* - (I* tiii<|(|iini tool:, dictionary entries. traivUomiations implications and synr.pec s ( an f>» created. 
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edited, and saved using interactive routines that ensure the correct format of those data types. It is 
also possible to give commands to activate synspecs using the same interface that the tutorials use to 
the generator, or to set constraints "by hand". Flexibility is provided to control the generation 
process in a number of ways facilitating the development and testing of the generator. 

The full power of the InterLISP system is available to the playground user as well as the specific 
commands designed for the interface. Thus a base tree can be edited directly, as can any version of 
the tree during the derivation process. Transformations can also be "broken" like functions so that 
when a transformatiop/s about to be tried the generator go5»-into a "break' 1 and conducts an 
interactive dialogue with the user who can then control the matching of the Structural Description, 
examine the results of the match, allow (or prohibit) the application of the Structural Change, edit the 
transformation and try it again, and perform many of the operations that are available in the 
playground. In addition to the break package, there is a trace option which prints a variety of 
information during the production of a sentence such as the constraints selected by the system, the 
words chosen for the base tree, the transformations which are attempted and whether they succeed 
or fail. The playground has proved to'be a powerful tool for exploring and demonstrating the 
interaction of various rules and. the efficacy of the whole generation package. A complete list of the 
commands that are available in the Playground is given in "ILIAD Data Base Reference". 
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6. Microcomputer Implementation 

The Micro ILIAD generation system has two subsystems, the utility section and the generation 
section. The utility section provides definitions and processing procedures for a variety of data 
structures used by the generation section. This has no analogue in the InterLISP version of ILIAD, 
since InterLISP pre , ides these functions in the language itself. The generation section corresponds 
to the generation part of ILIAD, and includes a syntactic base component, a semantic component, 
and a transformational component. Two different semantic components have been implemented to 
test different methods of semantic representation. The tutorials have not yet been converted to 
Pascal. 

6.1 Utility Section 

A major design consideration for MicrolLIAD has been to make use of existing InterLfSP ILIAD 
code where possible, in order to ensure compatibility between the systems and to reduce the 
programming effort as modifications are made. To provide for this capability, a list processing system 
has been implemented in Pascal which handles most of the functions normally provided by a small 
InterLISP system but which has the function definitions in Pascal (rather than using a separate 
interpreter) to allow intermixing of InterLISP-like and Pascal operations. Thus all the InterLISP ILIAD 
data structures (alphabetic atoms, small integers, and arbitrary structures built fro(n these) can be 
represented, although not all the vast collection of InterLISP functions have~been defined in the 
Pascal system. 

As the MicrolLIAD system evolved, itibecame dear that the time and memory requirements for 
having a system with lists as the primary data structure would be prohibitive, so other data structures 
have been designed. The trees used throughout the system for representing sentences are stored 
efficiently using Pascal records linked together. To minimize space used by large collections of data 
(such as the transformations and the dictionary), an extremely compact coding has been developed 
where most of the significant data objects in the ILIAD system {node names, names of structural 
change functions, semantic categories, feature names and values, structural description elements) 
have been assigned single byte codes, alternately treated as small integers (for subscript 
computations) and characters (fur storage as elements of character strings). One of the major utility 
.modules provides definitions of the various codes and other data structures and routines to 
manipulate th< '.»■ Mine lures 

o * 
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In order to retain some compatibility with the InterLISP ILIAD system, as new data structures 
have been used in MicrolLIAD, these new structures have been designed to be isomorphic to the 
InterLISP ILIAD structures, and programs have been provided to convert between the two sets. It is 
now possible to take an InterLISP ILIAD tree and convert it to MicrolLIAD form, and to take a 
transformation from the InterLISP ILIAD transformation list and convert it automatically to MicrolLIAD 
form. These conversions allow checking of transformations by directly comparing the operation of an 
^ InterLISP ILIAD transformation applied to a certain base tree with the result of the converted 
transformation applied to the converted base tree. Similarly, a grammatical rule expressed in 
InterLISP form can be converted to internal MicrolLIAD form. (Although these InterLISP grammatical 
rules are not actually used within the ILIAD system, they have been written for part of the base 
grammar, and provide a readable version of this grammar.) 

6.2 Generation Section 

t The generation section has the same major tasks as in InterLISP ILIAD, but the division oflabor 
among them is different In MicrolLIAD, generation of a syntactic base structure is separated from 
lexical insertion and semantic analysis. This allows backup for alternate choices of words to meet 
semantic constraints without the necessity, of replacing already generated syntactic structures. The 
transformational component operates very similarly to the InterLISP version, including in both 
systems a transformational morphology component. 

6.2,1 Base Component 

The base component is the first generation module used in the course of generating a 
sentence. Its function is to start with a set of base constraints specifying information about the 
syntactic form to be generated and to create a base tree, with nodes where lexical insertion will occur 
indicated by markers (e.g ••NOUN**, **VERB*\ etc.). 

The base constraints are stored in Pascal records of two types, clause level constraints 
(specifying for example whether the verb is transitive or intransitive) which in turn point to constraint 
records for the noun phrases associated with the clause (subject, direct object, etc.). The noun 
constraints give information such as presence or absence of adjectives, person and number, apd 
whether the phrase is definite or indefinite. In the case of noun phrases containing relative clauses 
(not presently u&:d) a the noun constiaints will point to the clause* constraints of the relative clause. 

J£ . 60 °*~ 
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The otherlnput to the base component is the base grammar. The grammar is originally 
specified as a LISP data structure in tbe form of an association list, giving possible expansions for 
each type of node depending on the base constraints. EMce use in MicrolLIAD, it is converted by 
program FILEGRAM into a Pascal record, where each set of possible expansions for qusiven uode is 
indexed by the code for that type of node. This allows much faster access to the grammatical rules 
for a node. Logic coded within the base component determines which of a set of expansions is 
appropriate for a gitfen set of base constraints. When an expansion is chosen, the nodes to be 
generated by the expansion are linked into the base tree and in'turn expanded by a recursive call to 
the basic tree building function. 

* The output of the base component is a tree with nodes and feattires the same as the base tree 
of InterLISP ILIAD, but the data representation is different, and the leaves of the tree contain markers 
specifyirg the part of speech rather than words. This tree is then passed to the semantic component 
which replaces the markers with words to cr^aie the final base tree. 

6.2.2 Feature-Based Semantics v 

The first semantic system implemented was based on use of semantic features. It operates 
after the base tree has been generated, #nd finds words to fill in the nodes marked with part of speech 
markers (e.g. "NOUN* *). The system does lexical insertion in such a way that each word inserted is 
compatible with the base structure and all previously inserted words. 

Each word has two types of features. One feature set is the features belonging to the word 
itself. For example, a verb might be marked as transitive, or a noun as HUMAN. The other type Qf 
features corresponds to Katz & Fodor style selectional restriction. For example, a verb might be 
marked as requiring an animate subject. Each word has one set of self-features plus up to three sets 
of selectional restrictions. These are generally used in r conventional manner, such as selectional 
restrictions applying from the verb to the nouns in its case frSme, but could potentially apply in the 
opposite direction (e.g. a noun might have restrictions on an associated verb for which it is an object). 
This would be useful for allowing MicrolLIAD to deal with idioms, in which such restrictions on the 
verb that a particular noun can occur with are common (e.g. the noun "headway" can only freely 
occur after the verb "make"). 

Each foaturo is. in fact, encoded a3 a pair of iMns corresponding to the foajturt* its opposite 
q r* < t 

ERIC 6i ^ 



anek and Newman Inc. Report No. 4771 

r 

4 

(e.g. ANIMATE, INANIMATE). A feature which has a certain definite value will be marked by both the 
presence of the feature and the absence of its opposite (e.g. ANIMATE, NOT INANIMATE), while an 
optional or unspecified feature will have both the feature and its opposite specified. Selectional 
restrictioris arg coded similarly, except that an unspecified selectional restriction is coded by having 
neither the feature nor its opposite (e.g. NOT ANIMATE, NOT INANIMATE). In this way, a selectional 
restriction can be tested by simply checking whether its features specified are a subset of the features 
of the item to which the restriction applies. Also, by reversing the "don't care" coding, the selectional 
restrictions can be merged (using a set intersection operation) with the original features to give the 
effect of "transfer features", (for example, the verb "bark" might be marked as requiring a dog as 
subject (ignoring seals for the sake of this example), so in the sentence "The animal barked", the 
selectional restriction would imply that "the animal" was, in fact, a dog,) 

Each word in the dictionary is marked with its part of speech and its feature set, and words of 
the appropriate class and compatible features are randomly selected for insertion into the base tree. - 

* As the words are inserted, a combined feature representation (original features plus transfer features) 
is built for each word, so that all words will biocompatible when lexical insertion is finished. The final 
output from the semantic component is the original base tree with the part of speech markers 
replaced by words, ready for processing by the transformational component. 

6.2.3 KLONE-Based Generation 

The description of the semantic design based on the KLONE language is given in section 3.2.3. 
This section describes the particular implementation used for MicrolLIAD, including issues of the 

* interaction between the base component and the semantic component. The KLONE-based 
generation system uses a somewhat different control structure than the feature-based semantics 
system. In the feature-based version, the base tree was generated initially, then semantics was called 
to find words to fill in nouns, veibs, and adjectives in the tree, In the KLONE version, generation is 
initiated by the KLONE system's interpreting a KLONE structi^e. which determines both the base 
constraints and the words to eventually be inserted in the base tree Then, the base constraints are 
passed to the base component to generate the base tree, and finally the KLONE selected words are 
inserted in the tree, This organization allows a higher level of interaction between syntax and 
semantics while still maintaining some d^iree of modularity The KLONE system does not do direct 
generation of base truos; instead, generation is mediated by the? same baso constraints, used in the 
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previous system, so the KLONE semantics needs to know about base constraints but not^about the 

grammar. 

At present, the KLONE network on which generation is based is a unitary network which 
contains both general knowledge and specific instances' of scenarios. A specific action node is 
selected for verb generation, and this node contains fillers for the various roles (acto^V^ect. etc.), 
which are then used to generate the associated noun phrases Most nodes contain a printable name 
by which they can be referenced, During generation, this name is selected as one of the words to be 
inserted in the base tree in the appropriate location. The generator allows a reference to be either to ' 
the specific node in the scenario (e.g. "Joe*'), or to a node on the SUPERC chain (e.g. "the child"'). 
There is*a rule of thumb that no more than 2 SUPERC links can be traversed to find a node governing 
a print-name (to avoid, for example, "the human"), and no node with a nonprintable name (e.g. 
•PHYSOBJ*) will be used during generation. 

As the KLONE structure is traversed, syntactic information also stored in the network is 
checked in order to set base constraints (e g if a node has part-of-speech *PROPERNOUN\ then 
base constraints will be set to skip generation of adjectives and determiners for this node) and to 
determine that the node has the correct part of, speech for the portion of the base tree being 
generated (for example, a modifier role for a noun might be syntactically expressed as either an 
adjective or a prepositional phrase, and the part of speech links would distinguish these cases). 
Using the KLONE nodes which have been visited, the KLONE*based*generator makes a table of parts 
of speech, grammatical relations (e.g. subject direct- object) and the words selected for these 
categories. It then passes the base constraints which have bfcen determined to the base component, 
tak«s the base tree output, and inserts the words fi om its table. The rebult is a lexicalized base tree 
ready for processing b> the transformational con iponent. * 

6.2.4 Transformational Component 

The transformational component operates on the base tree after the semantics component has 
done lexical insertion, and produces a final tree ready to be passed to the sentence printing routine 
The leaves of the transformed tree contain the ImAI sentence form except for soiiu (Mails such as 
capitalization and punctuation which are done by \Uv printing i online 

There are two tias .o* of liair fomuSiom, syntactic onj inotpholotjital The syntactic 
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transformations add, delete, or reorder constituents, while the morphological ones operate on the 
words at the leaves of the tree. The MicrolLIAD transformations have the same information, although 
a different representation, as the InterUSP transformations described in Section 3. 1 .2 

> 

Each transformation has two major parts, the Structural Description and the Structural Change, - 
plus a section for flags (for example, to indicate it the transformation is repeatable). The Structural 
Description and Structural Change are both represented as a sequence oj^Ktes* In the Structural , 
Description; these .codes are interpreted as node names, variables, or other objects specifying how 
the Structural Description is to match the tree In the Structural Change, they specify functions to 
perform and-parameters for the functions, ^ , * 

As with the base grammar for MicrolLIAD. there are two forms for representation of the 
transformations. One formns a list structure, identical to the InterLISP representation, and, in fact, 
transferred directly from InterLISP ILIADIo MicrolLIAD. The other form is a Pascal record containing ■ 
the sequences of codes described above. -In the second hrm, each transformation is indexed by 
number (to reduce the size of the transformation file by eliminating long names), The use of numeric 
indices and coded transformations reduces the size so that the present transformation list is all 
available in primary mertiory when' MicrolLIAD is run, A utility program. FILTRANS, is used to convert 
the LISP format transformations into MicrolLIAD format. 

During operation, the transformational* component first attempts to match the Structural 
Description to an input tree, taking into account specifications of specific nodes, variables, features, 
and optional constituents. If the Structural Description is matched, the Structural Change is 
interpieted and applied to the tree, moving or modifying constituents as specified. When the ordered 
list of applicable transformations has been applied, the result is a final tree whose leaves are the 
words of the output sentence in the correct sequence, which are then printed by the output routine. 
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7. Dissemination 

ILIAD has been disseminated in the form of reports and presentations to interested educators 
and designers of computer-based instructional systems. ILIAD has been disseminated via the 
ILIAD/Deafnet project in a more direct way allowing deaf children and adults to use the system via 
terminals in their homes or classrooms. 

r 

7.1 Reports and Presentations 

The following reports and papers have beehtRfoduced during the ILIAD project. 
Technical Reports: 

Kirk Wilson and Madeleine Bates, ILIAD; A Generative Computer System to Teach Language to the 
Deaf, Technical Progress Report, Sept., 1978 - April, 1979. 

Kirk Wilson and Madeleine Bates, ILIAD; A Generative Computer System to Teach Language to the 
Deaf, Technical Progress Report, April, 1979 - Sept., 1979. 

Kirk Wilson and Madeleine Bates, ILIAD; A Generative Computer System to Teach Language to the 
Deaf, Technic^JZco^jress Report, Sept., 1979 • March, 1980. 

Kirk Wilson and Madeleine Bates, ILIAD: A Generative Computer System to Teach Language to the 
Deaf, Technical Progress Report, March, 1980 • Sept., 1980. 

Kirk Wilson and Madeleine Bates, ILIAD; A Generative Computer System to Teach Language to the 
Deaf, Technical Progress Report, Sept., 1980 - March^lgSI . 

Kirk Wilson and Madeleine Bates* ILIAD Data Base Reference, Technical Report, Sept. 1981. 

Papets: y . , 

V' 

Kirk Wilson and Madeleine Boles. ll A Generative Computer System to Tdach Language". Conference 
of the Association for the Developmenf of computer-based Instruptional Systems. March 1979, 
' San Diego, California. m ^ - 

Madeleine Bates and Kirk Wilson. "A Natural Language Microcomputer System for. English 
Instruction". Conference of the Society for Learning Technology, May. 19/9, Washington, D.C. 

4 

Kirk Wilson, "Using computers in language and reading instruction,", Second Annual Massachusetts 
Office of Deafness Convention for Service Providers to Hearing Impaired Ind viduals, October 
29 t 1979, rramingh im, Massachusetts. 



Madeleine Bates and Kirk Wilson, "Project Report on ILIAD", Conference of the Association for 
Development of Computer-based Instructional Systems. March, 1980, Washington, D.C. 

Madeleine. Bates and Kirk Wilson, "Language instruction without pre-stored sentences", 1980, in 
Proceedings of the 3rd Canadian Symposium on Instructional Technology, Vancouver, British 
Colombia. 

Madeleine Bates, Jack Beinashowitz, Robert Ingria and Kirk Wilson, "Generative Tutorial Systems' 1 , 
1981, in Proceedings of the 1981 Association for the Development of Compvter-Based 
Instructional Systems Conference, Atlanta, Georgia, March 3. 

Kirk Wilson and Madeleine Bates, "Artificial intelligence in computer-based language instruction", 
1981, in F.Withrow (Ed.) Learning Technology and the Hearing Impaired, Alexander Graham 
Sell Association for the Deaf, Washington, D.C. 

Madeleine Bates and Robert Ingria, "Controlled Transformational Sentence Genera jn", 1981, in 
Proceedings of the 1981 Annual Meeting of //k Association for Computational Linguistics, 
Stanford, California, July 1. 

Kirk Wilson, A Bibliography of English Language Development in Deaf Children and Adults, 1981, 
Gallaudet College Press, Washington, O.C. 

Theses: 

Jack Beinashowitz, A Constraint Based Interface which Protects the User from Making Incompatible 
Specifications, MA Thesis, Department of Mathematics, 1981 , Boston University, 

Varda Shaked, Representation of Nominal Concepts in Semantic Networks: Application for 
Generation of Predicate Nominal Sentences, M.A, Thesis, Department ol Mathematics, 1981, 
Boston University. 

Presentations: 

Presentations of ILIAD were given at the University of Massachusetts at Amherst, Columbia 
University, Gallaudet College. University of California Medical School at San Francisco, 
California State University at Northndge and the California School for the Deaf at Berkeley. 

7.2 ILIAD/Deafnet Project 

The ILIAD/Deafnet project was supported by the Handicapped Media Services and Captioned 
Films Program to introduce ILIAD to deal children and adults and to bring deaf people into the design 
process ol the ILIAD language instruction system. Since the ILIAD/Dealnet project was in direct 
suppnit ot the objectives ol mam ILIAD project it is appropriate to indicate briefly m what ways 
ILIAD honi'liMI from Hit* mjjfit of doaf chiklirn and adults 
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Over the past two years the ILIAD system was introduced to (1) deaf adults using the Deaf 
Community Center Dealnet, (2) a class of deaf children at the Boston School for the Deaf, and, (3) 
during summers, eight deaf children of parent members of the Massachusetts Associetion for Deaf 
and Hard of Hearing Children. Users of ILIAD were taught how to use Hermes, an electronic message 
facility and the ILIAD message system, which allows students to send comments about ILIAD while 
within a tutorial (thereby avoiding the necessity to get out of the ILIAD tutorial program and into the 
Hermes message system to compose a message). In addition to messages received from the students 
regarding the positive and negative aspects of tutorials, the content of each tutorial session was 
recorded and reviewed to determine what kinds of problems students were having and which tutorials 
seemed to be most interesting (based on the frequency with which tutorials were selected and the 
number of items completed for each tutorial session). 

The classroom at the Boston School for the Deaf included ten and eleven year old deaf children 
with immediate access to ILIAD via a terminal located in the classroom. ILIAD was extremely well 
received by the teacher coordinating the student training at the school. Two of the ILIAD tutorials 
were developed in response to teacher requests and a large number of teacher suggestions for 
tutorial designs have been catalogued for future implementation. A more complete review of the 
ILIAD/Deafnet project is available in ILIAD/Deafnet technical reports (O.E, Grant #0007904514, 
Paul Andereck: Project Officer), 
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8. Future of ILIAD 

A substantial syntactic capability has been developed within thelUAD language tutorial system 
and considerable design effort has been given to ILIAD semantics. With \h\s linguistic foundation and 
our experience in the design and implementation of language tutorials for handicapped children, the 
ILIAD system has reached a point where a prototype system for dissemination may now be 
implemented on a low-cost microcomputer system. At the same time, a parallel effort should continue 
to expand the linguistics of ILIAD to incorporate an even broader range of syntactic structures, more 
features of KLONE semantics and an inference generation component. 

With a prototype implementation should come field-testing and refinement of the user interface 
to ILIAD. The user interface involves both the student's degree of understanding and control in ILIAD 
tutorials as well as the teacher's use of the system as a supplement to classroom instruction. 
Determining how to introduce ILIAD concepts and interactive power to a language'delayed student- 
user has been an on-goirig and unresolved problem. Considerable work remains to design an 
effective English or graphics-based metalanguage for controlling ILIAD tutorials. This work will 
include design of a simple interface for setting system constraints and for student-computer 
dialogues within tutorials. The student's ability to truly interact with the ILIAD system, particularly in 
using Help and Hint information, will be crucial to the system's usefulness and success. 
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A. Sentences Generated by ILIAD 

1« Transitive Sentences 

1 . The bullies chased the girl 

2. What did the bullies do to the girl? ^ « 

3. They chased her. 

4. Who chased thegirl? 

5. The bullies chased her. 

6. Who did they chase? 

7. Whom did they chase? 

8. They chased the girl. 

9. How many bullies chased the girl? 
? 10. Eight bullies chased the girl. 

11. Hoty many bullies chased her? 

12. Eight bullies chased her. 

13. Who got chased? 

14. The girl got chased. 

15. She was chased by the bullies. 

16. The girl was being chased by the bullies. 

* 2. Intransitive Sentences 

1. What did the girl do? 

2. She cried. 

3. Who cried?. 

4. The girl cried. 



3. Indirect Discourse 

1 . Dan said that the girl is sad. 

2. Dan said that she is sad. 

3. Who said that the girl is sad? 



4. Transitive Sentence with Indirect Objecl 

1 . The generousfcoy gave a doll to the girl. 

2. The generous boy gave the girl a doll. 

3. The giri was given a doll. 

4. A doll was given to the girl. 

5. Who gave the girl a doll? 

6. Who gave what to whom? 

7. What did the generous boy give the girl? 
a He g;ivo her a doll. 

9 What cIhJ the gomnous boy qivo to the girl? 
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10. He gave a doll to her. 

1 1 . Who gave a doll to the girl? 



12. Who gave the girl a doll? 

1 3. Which boy gave the girl a doll? 

14. The generous boy gave her a doll. 

15. Which boy gave a doll to the girl? 

1 6. The generous boy gave it to her. 

17. How many dolls did the generous boy give the girl? 

18. He gave her one doll. 

5. Comparative Sentences 

1 . The soldier was better. 

2. The gentleman will be more unhappy. 

3. Alicia is hungrier than Jake. 

4. The children were angrier than Andy. 

6. Superlative Sentences 

1. A policeman caught the nicest butterflies. 

2. A sheepdog was the sickest peC 

3. The fire chief looks most generous. 

4. The smartest man swore. 

5. The oldest bulldog broke the dolls. 

7. Sentences with Infinitives 

1. The teacher wanted Kafhy to hurry. 

2. The gentleman promised the lady to close the door. 

3. The girls were hard to ridicule. 

8. Relative Clauses 

1. Whoever embraced the kids will embrace the ladies. 

2. The girl who was intelligent cheated the adults. 

3. The woman who greased the tricycle mumbled. 

4. The tfeacher who lost the bulldogs swears. 

9. Negative Sentences 

1. Kim won't help.' 

2. Claire didn't help. 

3. The children won't shout. 

4. Do not slap the poodles. 

5. Do not cry. . 



>ER?C 72 



Report No. 4771 



Boltfieranek and Newman Inc. 



10. Varieties of Quantifiers 

1. No toy breaks. 

2. Some excited boys kissed the women. 

3. Some hungry people eat. 

4. Two men cried. 

5. Every new toy broke. 

6. Not every man slips. 

7. The boy won't give the dogs any oranges. 

8. The girl doesn't see any cats. 

9. The oid men didn't tell the boys any thing. ° 
10. The girl didn't love any body. 

11. Varieties of Pronouns 

LBette is the sad one. 

2. Gloria is the happy one. 

3. Kevin is the saddest. 

4. Kathy is the most cheerful. . # 

5. Varda liked the sweet apple. 

6. Varda liked the sweet one. 

7. The child tore the skirt. : 

8. That child tore the skirt. y ' 



12. TH^^Sentej^w^ 

1. There were some toys in the dirt. 

2. There were no toys in the dirt. 

3. There weren't any toys in the dirt. 

4. There wasn't any one on the bike. 

13. -/DEAF Sentences 

1. People no will eat. 

2. The woman will no tell the replies. 

3> The cookies were no eaten by the man. 
4. People not will eat. 

5 No the people did eat. 

6 The people did eat no 

7. Bully kidiic'Pfied ihe girls. 

8 Sewn m.m lohl the people the reply. 
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9. Six excited person told the girls the answer. 

10. The nice man was play with the dog. 

11. The cats are hide. 

12. The children will have tripping thewomari. 

13. The creatures have running away. 

14. The balls have nice. 

15. The dog have young. 

16. The cats be run away. 

17. Alicia be slipped. 

18. What the men give the dogs? 

19. What the girls tell the people? 

14.-** Ungrammatical Sentences 

1. Played thegame^who? 
2f Wh^rfdld lose Greg? 

3. Played the old teacher the games. 

4. Surprised who the youngsters? 



